Apr 14 02:51:32 user devstack@n-api.service[61661]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 02:51:32 user devstack@n-api.service[61661]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 02:51:32 2023] *** Apr 14 02:51:32 user devstack@n-api.service[61661]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 02:51:32 user devstack@n-api.service[61661]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 02:51:32 user devstack@n-api.service[61661]: nodename: user Apr 14 02:51:32 user devstack@n-api.service[61661]: machine: x86_64 Apr 14 02:51:32 user devstack@n-api.service[61661]: clock source: unix Apr 14 02:51:32 user devstack@n-api.service[61661]: pcre jit disabled Apr 14 02:51:32 user devstack@n-api.service[61661]: detected number of CPU cores: 12 Apr 14 02:51:32 user devstack@n-api.service[61661]: current working directory: / Apr 14 02:51:32 user devstack@n-api.service[61661]: detected binary path: /usr/bin/uwsgi-core Apr 14 02:51:32 user devstack@n-api.service[61661]: your processes number limit is 63637 Apr 14 02:51:32 user devstack@n-api.service[61661]: your memory page size is 4096 bytes Apr 14 02:51:32 user devstack@n-api.service[61661]: detected max file descriptor number: 2048 Apr 14 02:51:32 user devstack@n-api.service[61661]: lock engine: pthread robust mutexes Apr 14 02:51:32 user devstack@n-api.service[61661]: thunder lock: enabled Apr 14 02:51:32 user devstack@n-api.service[61661]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 02:51:32 user devstack@n-api.service[61661]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 02:51:32 user devstack@n-api.service[61661]: Python main interpreter initialized at 0x5557b0efa990 Apr 14 02:51:32 user devstack@n-api.service[61661]: python threads support enabled Apr 14 02:51:32 user devstack@n-api.service[61661]: your server socket listen backlog is limited to 100 connections Apr 14 02:51:32 user devstack@n-api.service[61661]: your mercy for graceful operations on workers is 90 seconds Apr 14 02:51:32 user devstack@n-api.service[61661]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 02:51:32 user devstack@n-api.service[61661]: *** Operational MODE: preforking *** Apr 14 02:51:32 user devstack@n-api.service[61661]: *** uWSGI is running in multiple interpreter mode *** Apr 14 02:51:32 user devstack@n-api.service[61661]: spawned uWSGI master process (pid: 61661) Apr 14 02:51:32 user devstack@n-api.service[61661]: spawned uWSGI worker 1 (pid: 61662, cores: 1) Apr 14 02:51:32 user devstack@n-api.service[61661]: spawned uWSGI worker 2 (pid: 61663, cores: 1) Apr 14 02:51:32 user devstack@n-api.service[61661]: spawned uWSGI worker 3 (pid: 61664, cores: 1) Apr 14 02:51:32 user devstack@n-api.service[61661]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 02:51:33 user devstack@n-api.service[61663]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 02:51:33 user devstack@n-api.service[61662]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 02:51:33 user devstack@n-api.service[61664]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 02:51:37 user devstack@n-api.service[61663]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 02:51:37 user devstack@n-api.service[61663]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 02:51:37 user devstack@n-api.service[61663]: and ``live_migration_inbound_addr`` respectively. Apr 14 02:51:37 user devstack@n-api.service[61663]: ). Its value may be silently ignored in the future. Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 02:51:37 user devstack@n-api.service[61664]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 02:51:37 user devstack@n-api.service[61664]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 02:51:37 user devstack@n-api.service[61664]: and ``live_migration_inbound_addr`` respectively. Apr 14 02:51:37 user devstack@n-api.service[61664]: ). Its value may be silently ignored in the future. Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 02:51:37 user devstack@n-api.service[61662]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 02:51:37 user devstack@n-api.service[61662]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 02:51:37 user devstack@n-api.service[61662]: and ``live_migration_inbound_addr`` respectively. Apr 14 02:51:37 user devstack@n-api.service[61662]: ). Its value may be silently ignored in the future. Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61662) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 02:51:37 user devstack@n-api.service[61663]: INFO dbcounter [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Registered counter for database nova_api Apr 14 02:51:37 user devstack@n-api.service[61664]: INFO dbcounter [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Registered counter for database nova_api Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG oslo_db.sqlalchemy.engines [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61663) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writer thread running {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG oslo_db.sqlalchemy.engines [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61664) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writer thread running {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61662]: INFO dbcounter [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Registered counter for database nova_api Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG nova.context [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8b826f37-092b-4c7e-8f9e-1e8629c22cd6(cell1) {{(pid=61663) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG oslo_db.sqlalchemy.engines [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61662) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG nova.context [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8b826f37-092b-4c7e-8f9e-1e8629c22cd6(cell1) {{(pid=61664) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 02:51:37 user devstack@n-api.service[61663]: INFO dbcounter [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Registered counter for database nova_cell0 Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writer thread running {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:51:37 user devstack@n-api.service[61663]: INFO dbcounter [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Registered counter for database nova_cell1 Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:51:37 user devstack@n-api.service[61664]: INFO dbcounter [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Registered counter for database nova_cell0 Apr 14 02:51:37 user devstack@n-api.service[61664]: INFO dbcounter [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Registered counter for database nova_cell1 Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG oslo_db.sqlalchemy.engines [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61663) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writer thread running {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG oslo_db.sqlalchemy.engines [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61663) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG oslo_db.sqlalchemy.engines [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61664) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writer thread running {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG oslo_db.sqlalchemy.engines [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61664) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG nova.context [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8b826f37-092b-4c7e-8f9e-1e8629c22cd6(cell1) {{(pid=61662) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:51:37 user devstack@n-api.service[61662]: INFO dbcounter [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Registered counter for database nova_cell0 Apr 14 02:51:37 user devstack@n-api.service[61662]: INFO dbcounter [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Registered counter for database nova_cell1 Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG oslo_db.sqlalchemy.engines [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61662) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writer thread running {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG oslo_db.sqlalchemy.engines [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61662) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writer thread running {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61663]: INFO dbcounter [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Registered counter for database nova_cell0 Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writer thread running {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG oslo_db.sqlalchemy.engines [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61663) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writer thread running {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61664]: INFO dbcounter [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Registered counter for database nova_cell0 Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG oslo_db.sqlalchemy.engines [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61664) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writer thread running {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writer thread running {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61662]: INFO dbcounter [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Registered counter for database nova_cell0 Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG oslo_db.sqlalchemy.engines [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61662) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:51:37 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writer thread running {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:51:37 user devstack@n-api.service[61663]: WARNING keystonemiddleware.auth_token [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 02:51:37 user devstack@n-api.service[61663]: WARNING keystonemiddleware.auth_token [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 02:51:37 user devstack@n-api.service[61664]: WARNING keystonemiddleware.auth_token [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 02:51:37 user devstack@n-api.service[61664]: WARNING keystonemiddleware.auth_token [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 02:51:37 user devstack@n-api.service[61662]: WARNING keystonemiddleware.auth_token [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 02:51:37 user devstack@n-api.service[61662]: WARNING keystonemiddleware.auth_token [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 02:51:38 user devstack@n-api.service[61663]: WARNING keystonemiddleware.auth_token [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 02:51:38 user devstack@n-api.service[61663]: WARNING keystonemiddleware.auth_token [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 02:51:38 user devstack@n-api.service[61663]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557b0efa990 pid: 61663 (default app) Apr 14 02:51:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:51:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001766 Apr 14 02:51:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 02:51:38 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:51:38 user devstack@n-api.service[61664]: WARNING keystonemiddleware.auth_token [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 02:51:38 user devstack@n-api.service[61664]: WARNING keystonemiddleware.auth_token [None req-73ad0fc6-7774-47e1-a9f4-11dfc075d962 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 02:51:38 user devstack@n-api.service[61664]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557b0efa990 pid: 61664 (default app) Apr 14 02:51:38 user devstack@n-api.service[61662]: WARNING keystonemiddleware.auth_token [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 02:51:38 user devstack@n-api.service[61662]: WARNING keystonemiddleware.auth_token [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 02:51:38 user devstack@n-api.service[61662]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557b0efa990 pid: 61662 (default app) Apr 14 02:53:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:53:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0e0b6974-e226-4674-b9b5-311dbbe841e4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001549 Apr 14 02:53:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:53:45 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:53:45 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:53:45 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:53:45 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:53:45 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:53:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8cf4cb6a-af61-436c-9ea2-014f4d0f30a7 admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:53:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8cf4cb6a-af61-436c-9ea2-014f4d0f30a7 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.434422 Apr 14 02:53:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 02:53:45 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:53:48 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:53:48 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002176 Apr 14 02:53:48 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:53:48 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:53:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:53:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:53:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:53:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:53:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-cb18da9c-10a8-4368-b2c6-cd6d9a8d908f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:53:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-cb18da9c-10a8-4368-b2c6-cd6d9a8d908f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.317336 Apr 14 02:53:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 02:53:48 2023] POST /compute/v2.1/flavors => generated 405 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:53:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9fcd3880-5d3f-4206-a3c0-75d07d519584 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:53:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9fcd3880-5d3f-4206-a3c0-75d07d519584 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043046 Apr 14 02:53:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 02:53:48 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:53:50 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:53:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001348 Apr 14 02:53:50 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:53:50 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:53:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-04b606e8-a77d-4629-bce4-726b57ef4749 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:53:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-04b606e8-a77d-4629-bce4-726b57ef4749 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067482 Apr 14 02:53:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 02:53:50 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:53:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-cb965d1f-058d-4bc4-8aa6-554d3d80c805 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:53:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-cb965d1f-058d-4bc4-8aa6-554d3d80c805 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031380 Apr 14 02:53:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 02:53:50 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:53:52 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:53:52 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001616 Apr 14 02:53:52 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:53:52 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:53:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f10fc845-d4ba-477c-8238-c1607be3098b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "id": "d2", "ram": 1024}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:53:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f10fc845-d4ba-477c-8238-c1607be3098b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066139 Apr 14 02:53:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 02:53:52 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 02:53:52 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e6940eb8-2469-4463-b73d-d78964031f88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:53:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e6940eb8-2469-4463-b73d-d78964031f88 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027911 Apr 14 02:53:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 02:53:52 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:53:54 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:53:54 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001318 Apr 14 02:53:54 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:53:54 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:53:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-abaaac41-4a45-4113-b677-a0cddc178cbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "vcpus": 2, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:53:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-abaaac41-4a45-4113-b677-a0cddc178cbc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067764 Apr 14 02:53:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 02:53:54 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:53:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-703e4ab0-75b7-465d-bb4b-004151210a5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:53:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-703e4ab0-75b7-465d-bb4b-004151210a5b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032667 Apr 14 02:53:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 02:53:54 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:53:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:53:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001339 Apr 14 02:53:56 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:53:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:53:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8bcfaa89-ea2b-417d-b199-48233faf0648 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "swap": 0, "name": "ds4G", "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:53:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8bcfaa89-ea2b-417d-b199-48233faf0648 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064837 Apr 14 02:53:56 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 02:53:56 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:53:56 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:53:56 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027604 Apr 14 02:53:56 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 02:53:56 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:53:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:53:58 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c580fce0-47d9-4072-86fc-d53bbbc8f318 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001345 Apr 14 02:53:58 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:53:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:53:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-963bc3ef-d0cd-4982-8e0e-79d89fbe982d admin admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:53:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-963bc3ef-d0cd-4982-8e0e-79d89fbe982d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.092839 Apr 14 02:53:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 02:53:58 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 02:54:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:54:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001736 Apr 14 02:54:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:54:00 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:54:00 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:54:00 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:54:00 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:54:00 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:54:01 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c376f16f-400f-42c6-9447-f1c1fe12af31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:54:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c376f16f-400f-42c6-9447-f1c1fe12af31 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.404658 Apr 14 02:54:01 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 02:54:00 2023] POST /compute/v2.1/flavors => generated 400 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:54:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-533c8703-f6f7-425a-8c3d-599ca5367691 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:54:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-533c8703-f6f7-425a-8c3d-599ca5367691 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046509 Apr 14 02:54:01 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 02:54:01 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:54:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:54:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001415 Apr 14 02:54:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:54:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:54:03 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-e4e81f27-cce4-4a77-a80c-4b0bf35f4356 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "vcpus": 1, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:54:03 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-e4e81f27-cce4-4a77-a80c-4b0bf35f4356 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.073224 Apr 14 02:54:03 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 02:54:03 2023] POST /compute/v2.1/flavors => generated 403 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:54:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-483dc70d-0525-46d8-9f2d-0e1ae933b92d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:54:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-483dc70d-0525-46d8-9f2d-0e1ae933b92d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028016 Apr 14 02:54:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 02:54:03 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:54:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:54:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001286 Apr 14 02:54:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:54:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:54:05 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a26235d9-8556-4995-96ab-91c43f2a5be2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:54:05 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a26235d9-8556-4995-96ab-91c43f2a5be2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089717 Apr 14 02:54:05 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 02:54:05 2023] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:54:05 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e24ff97a-d3eb-49d2-867a-9ee154cacf25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:54:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e24ff97a-d3eb-49d2-867a-9ee154cacf25 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027189 Apr 14 02:54:05 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 02:54:05 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:54:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:54:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001374 Apr 14 02:54:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:54:07 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:54:07 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3f6ad634-5218-4315-9f9d-850fc57eae4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:54:07 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3f6ad634-5218-4315-9f9d-850fc57eae4e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068857 Apr 14 02:54:07 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 02:54:07 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:54:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-24accc95-2d33-4079-a4e3-c100220a68aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:54:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-24accc95-2d33-4079-a4e3-c100220a68aa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026312 Apr 14 02:54:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 02:54:07 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:54:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:54:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001463 Apr 14 02:54:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 02:54:09 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:54:09 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-0ba92acb-8c7c-4356-a44a-928bee0feac4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:54:09 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-0ba92acb-8c7c-4356-a44a-928bee0feac4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.057718 Apr 14 02:54:09 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 02:54:09 2023] POST /compute/v2.1/flavors => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:54:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-63ba304a-6572-443b-9cf9-61cbbb2af270 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:54:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-63ba304a-6572-443b-9cf9-61cbbb2af270 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026102 Apr 14 02:54:09 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 02:54:09 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:54:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:54:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c3bda3f8-5e4c-4cc9-9f46-16c64f434afb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001433 Apr 14 02:54:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 02:54:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:54:40 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:54:40 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:54:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:54:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:54:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:54:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:54:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:54:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:54:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.109670 Apr 14 02:54:40 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 02:54:40 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:55:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-63ba304a-6572-443b-9cf9-61cbbb2af270 admin admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:55:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-63ba304a-6572-443b-9cf9-61cbbb2af270 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002437 Apr 14 02:55:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 02:55:12 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:55:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:55:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c56a8f85-1701-4a91-b88b-ba484903cfaa admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:55:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c56a8f85-1701-4a91-b88b-ba484903cfaa admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.068017 Apr 14 02:55:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 02:55:12 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 02:55:17 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:55:17 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001572 Apr 14 02:55:17 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 02:55:17 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:55:17 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:55:17 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-904f1092-4960-4366-b198-2ef08575bc12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "swap": 0, "ram": 128, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "42", "rxtx_factor": 1.0, "disk": 1}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:55:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-904f1092-4960-4366-b198-2ef08575bc12 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.070513 Apr 14 02:55:17 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 02:55:17 2023] POST /compute/v2.1/flavors => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:55:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3243001b-9ea4-4164-9023-243aba87527e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:55:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3243001b-9ea4-4164-9023-243aba87527e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024894 Apr 14 02:55:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 02:55:17 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:55:21 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:55:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-2ff053f3-4998-4eb2-aa0e-1700339579b7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001369 Apr 14 02:55:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 02:55:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:55:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5af5eeba-5a0d-4b18-8b6a-bd4e86c7a0e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 192, "disk": 1, "name": "m1.micro", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:55:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5af5eeba-5a0d-4b18-8b6a-bd4e86c7a0e8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063692 Apr 14 02:55:21 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 02:55:21 2023] POST /compute/v2.1/flavors => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:55:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7f443cb1-920f-41f7-a0be-4f6ac484bbe9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:55:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7f443cb1-920f-41f7-a0be-4f6ac484bbe9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024937 Apr 14 02:55:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 02:55:21 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:57:33 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:33 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:33 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:33 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f13251ee-160d-434d-8fdb-0b5b76e6d803 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Action: 'create', calling method: .version_select at 0x7ff11b267370>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-854961944"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Action: 'create', calling method: .version_select at 0x7ff11b27e560>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1984916011", "metadata": {"Type": "work"}}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.348068 Apr 14 02:57:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 17/46] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 02:57:34 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 1350 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 02:57:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1075179f-b4fd-4867-9a8d-4de9f54a6ec8 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Calling method '.version_select at 0x7ff11b254af0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:35 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1075179f-b4fd-4867-9a8d-4de9f54a6ec8 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc" status: 200 len: 353 microversion: 2.1 time: 0.371337 Apr 14 02:57:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 16/47] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:35 2023] GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc => generated 353 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f13251ee-160d-434d-8fdb-0b5b76e6d803 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.841209 Apr 14 02:57:35 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 15/48] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 02:57:33 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 2844 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 02:57:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-63332bbb-d896-4beb-aa8e-5db7a4f0af87 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b103760>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-63332bbb-d896-4beb-aa8e-5db7a4f0af87 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602" status: 200 len: 344 microversion: 2.1 time: 0.073463 Apr 14 02:57:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 18/49] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:35 2023] GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8238d56e-5786-4c91-b576-e5d846ca600a tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Calling method '.version_select at 0x7ff11b2f2dd0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8238d56e-5786-4c91-b576-e5d846ca600a tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc" status: 200 len: 354 microversion: 2.1 time: 0.062438 Apr 14 02:57:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:36 2023] GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-90a9eebd-9ea2-4cc5-9c1d-0274fa5efd45 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Calling method '.version_select at 0x7ff11b104a60>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0b6e1cc0-3685-4f46-92f7-fc8a2d61238a tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b103e20>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:36 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-90a9eebd-9ea2-4cc5-9c1d-0274fa5efd45 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc" status: 200 len: 354 microversion: 2.1 time: 0.059113 Apr 14 02:57:36 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 16/51] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:36 2023] GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-03f540d1-e990-4e88-98fe-9855e9c7fc52 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Calling method '.version_select at 0x7ff11b2f3490>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0b6e1cc0-3685-4f46-92f7-fc8a2d61238a tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602" status: 200 len: 344 microversion: 2.1 time: 0.057398 Apr 14 02:57:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 19/52] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:36 2023] GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-03f540d1-e990-4e88-98fe-9855e9c7fc52 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc" status: 202 len: 0 microversion: 2.1 time: 0.089567 Apr 14 02:57:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 18/53] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 02:57:36 2023] DELETE /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:57:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-58105094-d63a-4532-b052-2bd9cdd4ce84 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Calling method '.version_select at 0x7ff11b105120>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-58105094-d63a-4532-b052-2bd9cdd4ce84 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc" status: 200 len: 353 microversion: 2.1 time: 0.070149 Apr 14 02:57:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 17/54] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:37 2023] GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-544d4203-441d-44be-bed7-b85cd638ca01 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b103b50>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-544d4203-441d-44be-bed7-b85cd638ca01 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/1c3b6176-90dc-4f51-b393-442f39772db7" status: 200 len: 351 microversion: 2.1 time: 0.055369 Apr 14 02:57:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 20/55] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:37 2023] GET /compute/v2.1/os-volumes/1c3b6176-90dc-4f51-b393-442f39772db7 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8b6d84da-a911-46d4-93d3-99789f272299 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b2f3b50>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8b6d84da-a911-46d4-93d3-99789f272299 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602" status: 200 len: 345 microversion: 2.1 time: 0.080108 Apr 14 02:57:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 19/56] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:38 2023] GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:38 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-af4ab977-f715-4c7b-b416-074e82df0dc8 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Action: 'create', calling method: .version_select at 0x7ff11b105750>, body: {"snapshot": {"volume_id": "25c5361d-3ebe-4ab7-a6ff-857245bed602", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-964407920"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d967ce24-1ed8-4efb-aeb8-523f52a62cc3 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Calling method '.version_select at 0x7ff11b1035b0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d967ce24-1ed8-4efb-aeb8-523f52a62cc3 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc" status: 200 len: 353 microversion: 2.1 time: 0.055327 Apr 14 02:57:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 21/57] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:38 2023] GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-af4ab977-f715-4c7b-b416-074e82df0dc8 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.235498 Apr 14 02:57:38 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 18/58] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 02:57:38 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0928c1ff-7a54-4ff8-9c5e-e56483f7ca82 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b2f3c70>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0928c1ff-7a54-4ff8-9c5e-e56483f7ca82 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 200 len: 286 microversion: 2.1 time: 0.094174 Apr 14 02:57:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 20/59] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 02:57:38 2023] GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-132d7ffb-0015-474f-bc92-0014e9437bed tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b120670>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-132d7ffb-0015-474f-bc92-0014e9437bed tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.094360 Apr 14 02:57:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 22/60] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 02:57:38 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:38 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fa081646-219d-4ae7-9cd6-15b84d194876 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b106680>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-fa081646-219d-4ae7-9cd6-15b84d194876 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 200 len: 286 microversion: 2.1 time: 0.035646 Apr 14 02:57:38 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 19/61] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 02:57:38 2023] GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1a913c6d-75d7-4d26-81ee-6f22db8e7ab1 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Calling method '.version_select at 0x7ff11b2f35b0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1a913c6d-75d7-4d26-81ee-6f22db8e7ab1 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc" status: 200 len: 353 microversion: 2.1 time: 0.050713 Apr 14 02:57:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 21/62] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:39 2023] GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-44ba5cdd-11c6-41de-88e1-cace740780dc tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b103760>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-44ba5cdd-11c6-41de-88e1-cace740780dc tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 200 len: 286 microversion: 2.1 time: 0.040935 Apr 14 02:57:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 23/63] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 02:57:39 2023] GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:40 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d17d176f-e114-4b61-b9e7-8c696ed80262 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b105fc0>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d17d176f-e114-4b61-b9e7-8c696ed80262 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4f3d0e6b-94ce-4891-b038-f00902d4cc5f" status: 200 len: 351 microversion: 2.1 time: 0.061071 Apr 14 02:57:40 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 20/64] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:40 2023] GET /compute/v2.1/os-volumes/4f3d0e6b-94ce-4891-b038-f00902d4cc5f => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-81e84604-f5b5-423b-ad17-a1ab2626d763 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Calling method '.version_select at 0x7ff11b2f3010>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-81e84604-f5b5-423b-ad17-a1ab2626d763 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc" status: 200 len: 353 microversion: 2.1 time: 0.098761 Apr 14 02:57:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 22/65] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:40 2023] GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-10a53b1d-339b-45e5-ada4-90d41424ae27 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b1215a0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-10a53b1d-339b-45e5-ada4-90d41424ae27 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 200 len: 286 microversion: 2.1 time: 0.056538 Apr 14 02:57:40 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 24/66] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 02:57:40 2023] GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-eefd748c-4110-4deb-844a-31f79ef5a86a tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Calling method '.version_select at 0x7ff11b1056c0>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-eefd748c-4110-4deb-844a-31f79ef5a86a tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc" status: 200 len: 353 microversion: 2.1 time: 0.072192 Apr 14 02:57:41 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 21/67] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:41 2023] GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ad5ffb70-4033-45d9-9464-864c90a1f7c3 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b2f30a0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ad5ffb70-4033-45d9-9464-864c90a1f7c3 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 200 len: 286 microversion: 2.1 time: 0.064189 Apr 14 02:57:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 23/68] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 02:57:41 2023] GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3f1d1f77-d99a-4fcb-8807-f56f3088fcf3 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Calling method '.version_select at 0x7ff11b121090>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-3f1d1f77-d99a-4fcb-8807-f56f3088fcf3 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] HTTP exception thrown: Volume 4466f12b-7d3e-42e0-9b51-daf7405408bc could not be found. Apr 14 02:57:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3f1d1f77-d99a-4fcb-8807-f56f3088fcf3 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Request method failure captured: Apr 14 02:57:42 user devstack@n-api.service[61663]: request: GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc HTTP/1.1 Apr 14 02:57:42 user devstack@n-api.service[61663]: Accept: application/json Apr 14 02:57:42 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 02:57:42 user devstack@n-api.service[61663]: Connection: close Apr 14 02:57:42 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 02:57:42 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 02:57:42 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 02:57:42 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 02:57:42 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMEdXxR-0AmluAU6WOybM-SZUq5eosIgAZrDvdFQPJwqSkm6GPKYCorpy_bIKAqmmTCiA4uKMgmKQbx-ZP6C_REH-aByF5xtH0alVJr5Gp30EWk4iljSyxPGK3cvL9Hu3KPjeje0YkFZgpP0n3RJ-NOSuc2GF_cgY7vrwu7Ag1IrAdI Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Project-Id: 09a7a892d1cf42f0bb80ec6597a38f29 Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesGetTestJSON-1380130811 Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/09a7a892d1cf42f0bb80ec6597a38f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/09a7a892d1cf42f0bb80ec6597a38f29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/09a7a892d1cf42f0bb80ec6597a38f29"}]}] Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesGetTestJSON-1380130811 Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Tenant-Id: 09a7a892d1cf42f0bb80ec6597a38f29 Apr 14 02:57:42 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesGetTestJSON-1380130811 Apr 14 02:57:42 user devstack@n-api.service[61663]: X-User: tempest-VolumesGetTestJSON-1380130811-project-member Apr 14 02:57:42 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 02:57:42 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 02:57:42 user devstack@n-api.service[61663]: X-User-Id: d080bf0706234c1fb084015921fad1fa Apr 14 02:57:42 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesGetTestJSON-1380130811-project-member Apr 14 02:57:42 user devstack@n-api.service[61663]: method: Apr 14 02:57:42 user devstack@n-api.service[61663]: exception: Volume 4466f12b-7d3e-42e0-9b51-daf7405408bc could not be found. Apr 14 02:57:42 user devstack@n-api.service[61663]: action_args: {'id': '4466f12b-7d3e-42e0-9b51-daf7405408bc'} Apr 14 02:57:42 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4466f12b-7d3e-42e0-9b51-daf7405408bc could not be found. (HTTP 404) (Request-ID: req-3a47e2e6-e73b-44fd-b047-462e2b595b7a) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4466f12b-7d3e-42e0-9b51-daf7405408bc could not be found. Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4466f12b-7d3e-42e0-9b51-daf7405408bc could not be found. Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4466f12b-7d3e-42e0-9b51-daf7405408bc could not be found. Apr 14 02:57:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3f1d1f77-d99a-4fcb-8807-f56f3088fcf3 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] Returning 404 to user: Volume 4466f12b-7d3e-42e0-9b51-daf7405408bc could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3f1d1f77-d99a-4fcb-8807-f56f3088fcf3 tempest-VolumesGetTestJSON-1380130811 tempest-VolumesGetTestJSON-1380130811-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc" status: 404 len: 109 microversion: 2.1 time: 0.040433 Apr 14 02:57:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 25/69] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:42 2023] GET /compute/v2.1/os-volumes/4466f12b-7d3e-42e0-9b51-daf7405408bc => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:57:42 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-ee6730b9-3eba-4994-a14c-f354e5e0846c tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b105240>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:42 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-ee6730b9-3eba-4994-a14c-f354e5e0846c tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cbb70dad-3e25-4c25-9ee2-6372362ef157" status: 200 len: 351 microversion: 2.1 time: 0.057921 Apr 14 02:57:42 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 22/70] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:42 2023] GET /compute/v2.1/os-volumes/cbb70dad-3e25-4c25-9ee2-6372362ef157 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9282c909-7d5a-46f8-8f76-b58566cdec74 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b2f3760>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9282c909-7d5a-46f8-8f76-b58566cdec74 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.091308 Apr 14 02:57:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 24/71] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 02:57:42 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:57:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d5855a51-6463-4ef8-89dd-ff53e260dc44 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b120550>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:42 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-7f23db87-4c40-43b7-971f-1d7d86dd678a tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b105ea0>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:42 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-7f23db87-4c40-43b7-971f-1d7d86dd678a tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 200 len: 287 microversion: 2.1 time: 0.046041 Apr 14 02:57:42 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 23/72] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 02:57:42 2023] GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9aa56817-94fa-4af5-b3f6-0743891a295b tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b1049d0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d5855a51-6463-4ef8-89dd-ff53e260dc44 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.107398 Apr 14 02:57:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 26/73] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 02:57:42 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:42 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-65be4adb-922f-4f9c-b49b-190079d10db4 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b106440>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9aa56817-94fa-4af5-b3f6-0743891a295b tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 202 len: 0 microversion: 2.1 time: 0.091132 Apr 14 02:57:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 25/74] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 02:57:42 2023] DELETE /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:57:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7d7de25d-0bed-4988-894e-18472d0a0f40 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b27e440>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7d7de25d-0bed-4988-894e-18472d0a0f40 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 200 len: 286 microversion: 2.1 time: 0.042835 Apr 14 02:57:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 27/75] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 02:57:42 2023] GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-65be4adb-922f-4f9c-b49b-190079d10db4 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.120103 Apr 14 02:57:43 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 24/76] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 02:57:42 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:57:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-59a89592-c8ef-4459-9317-ac2b16b991a0 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b2f3880>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-59a89592-c8ef-4459-9317-ac2b16b991a0 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.139506 Apr 14 02:57:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 26/77] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 02:57:43 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-471aa15e-926b-4060-9c64-b519e4c827db tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b121e10>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-471aa15e-926b-4060-9c64-b519e4c827db tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.147662 Apr 14 02:57:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 28/78] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 02:57:43 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0ddaf24c-a4b7-43e3-942a-0446fe170dac tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b104c10>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0ddaf24c-a4b7-43e3-942a-0446fe170dac tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.106446 Apr 14 02:57:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 27/79] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 02:57:43 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:57:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f0aec905-372f-463a-b002-3706b3d8dc66 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b1223b0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:43 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c7d6479b-c894-4359-97e5-03cf9e4e0c84 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'create', calling method: .version_select at 0x7ff11b267f40>, body: {"keypair": {"name": "tempest-keypair-1156063861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeBO3Puf45GsCORiHAZ27NGwlcWdsEQ3UWkZa0RxlsM/TNUaZ2QpW5Vj4DhEQilp60b+VAsZqstaUKI2WmSuZE1HgEzm2SMgB1a286kwGwkyhWrq2SJzF9Whk3OEHbnug=="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:43 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-c7d6479b-c894-4359-97e5-03cf9e4e0c84 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Getting quotas for project 130665008cf648cf87467ae2777a9170. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:57:43 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-c7d6479b-c894-4359-97e5-03cf9e4e0c84 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Getting quotas for user d6d78d4991b5493e8893034e91ed407b and project 130665008cf648cf87467ae2777a9170. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:57:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f0aec905-372f-463a-b002-3706b3d8dc66 tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.133988 Apr 14 02:57:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 29/80] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 02:57:43 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-fd8fc0c6-3951-4c78-8c38-878600119f2d tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] Calling method '.version_select at 0x7ff11b2f3be0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c7d6479b-c894-4359-97e5-03cf9e4e0c84 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.345551 Apr 14 02:57:43 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 25/81] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:57:43 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-fd8fc0c6-3951-4c78-8c38-878600119f2d tempest-VolumesTestJSON-1140083610 tempest-VolumesTestJSON-1140083610-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.100105 Apr 14 02:57:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 28/82] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 02:57:43 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:57:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0c2be6d0-e196-498a-8489-6918eaf0a7e1 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b1216c0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0c2be6d0-e196-498a-8489-6918eaf0a7e1 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 200 len: 286 microversion: 2.1 time: 0.051185 Apr 14 02:57:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 30/83] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 02:57:44 2023] GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:45 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-47926995-c1b3-4ff5-8c9c-961a4757a889 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b161cf0>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:45 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-47926995-c1b3-4ff5-8c9c-961a4757a889 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 200 len: 286 microversion: 2.1 time: 0.044368 Apr 14 02:57:45 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 26/84] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 02:57:45 2023] GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8e190647-d60c-4b28-9c2b-2684c4a37adf tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b105120>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-8e190647-d60c-4b28-9c2b-2684c4a37adf tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] HTTP exception thrown: Snapshot 092f4172-6dec-4e27-923c-feb6555b1c79 could not be found. Apr 14 02:57:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8e190647-d60c-4b28-9c2b-2684c4a37adf tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Request method failure captured: Apr 14 02:57:46 user devstack@n-api.service[61664]: request: GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 HTTP/1.1 Apr 14 02:57:46 user devstack@n-api.service[61664]: Accept: application/json Apr 14 02:57:46 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 02:57:46 user devstack@n-api.service[61664]: Connection: close Apr 14 02:57:46 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 02:57:46 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 02:57:46 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 02:57:46 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 02:57:46 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEc5TqNskULGclzvOaKsk0TJem7nQjXihzXXCjZpBNxctoQC-N050bn4xchQnFCDFPrR7YvsJGVAH3hHNElgiczv6NQXGyJWFz92DmudrNrEx3RcU1qtpO8p3ye8yIJIgwGgwyZ6ankf5WgwnuSfOGrTQwt7gAk80npgHQm7NDHgmU Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Project-Id: cb86fd9df08a4b1c805d5a73291c003c Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb86fd9df08a4b1c805d5a73291c003c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb86fd9df08a4b1c805d5a73291c003c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb86fd9df08a4b1c805d5a73291c003c"}]}] Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Tenant-Id: cb86fd9df08a4b1c805d5a73291c003c Apr 14 02:57:46 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:46 user devstack@n-api.service[61664]: X-User: tempest-VolumesSnapshotsTestJSON-1239932062-project-member Apr 14 02:57:46 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61664]: X-User-Id: 0c2ba1fb92fd4c739939c03115d3affa Apr 14 02:57:46 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1239932062-project-member Apr 14 02:57:46 user devstack@n-api.service[61664]: method: Apr 14 02:57:46 user devstack@n-api.service[61664]: exception: Snapshot 092f4172-6dec-4e27-923c-feb6555b1c79 could not be found. Apr 14 02:57:46 user devstack@n-api.service[61664]: action_args: {'id': '092f4172-6dec-4e27-923c-feb6555b1c79'} Apr 14 02:57:46 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 092f4172-6dec-4e27-923c-feb6555b1c79 could not be found. (HTTP 404) (Request-ID: req-b4ca5a51-c866-4759-a50d-e26bde1326f5) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 092f4172-6dec-4e27-923c-feb6555b1c79 could not be found. Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 092f4172-6dec-4e27-923c-feb6555b1c79 could not be found. Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 092f4172-6dec-4e27-923c-feb6555b1c79 could not be found. Apr 14 02:57:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8e190647-d60c-4b28-9c2b-2684c4a37adf tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Returning 404 to user: Snapshot 092f4172-6dec-4e27-923c-feb6555b1c79 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8e190647-d60c-4b28-9c2b-2684c4a37adf tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79" status: 404 len: 111 microversion: 2.1 time: 0.044526 Apr 14 02:57:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 29/85] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 02:57:46 2023] GET /compute/v2.1/os-snapshots/092f4172-6dec-4e27-923c-feb6555b1c79 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-da355ede-87b7-4a66-9086-734b3a90650b tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b1623b0>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-da355ede-87b7-4a66-9086-734b3a90650b tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602" status: 202 len: 0 microversion: 2.1 time: 0.074572 Apr 14 02:57:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 27/86] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 02:57:46 2023] DELETE /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3c209a81-5d30-46ec-b86f-b62c4bd9de1a tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Action: 'create', calling method: .version_select at 0x7ff11b121b40>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1015626502", "metadata": {"Type": "work"}}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3c209a81-5d30-46ec-b86f-b62c4bd9de1a tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Request method failure captured: Apr 14 02:57:46 user devstack@n-api.service[61663]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 02:57:46 user devstack@n-api.service[61663]: Accept: application/json Apr 14 02:57:46 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 02:57:46 user devstack@n-api.service[61663]: Connection: close Apr 14 02:57:46 user devstack@n-api.service[61663]: Content-Length: 122 Apr 14 02:57:46 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 02:57:46 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 02:57:46 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 02:57:46 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMEpJlJoffg1Aau2OzIjwsbC-ZUD5SrUCN-_-1zHgvRx0dJaApwtinRE55SmFkf4M80Ys05k3VOBGqXVeL58biKtNkNDAntBpdswGU7hKW8JDEjKiBITcA8DeCFwB7v1j70Vy7SyuAzNy2VZ4sxIVzmTlbuynYxALRd8bYB0GIsO0N8 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c4b9e75f975e4067a2fd38d46941384b"}]}] Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Tenant-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Id: 64585225cdb44ab3b36cb391bf5b4df1 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61663]: Apr 14 02:57:46 user devstack@n-api.service[61663]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1015626502", "metadata": {"Type": "work"}}} Apr 14 02:57:46 user devstack@n-api.service[61663]: method: Apr 14 02:57:46 user devstack@n-api.service[61663]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 02:57:46 user devstack@n-api.service[61663]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1015626502', 'metadata': {'Type': 'work'}}}} Apr 14 02:57:46 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise error Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3c209a81-5d30-46ec-b86f-b62c4bd9de1a tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3c209a81-5d30-46ec-b86f-b62c4bd9de1a tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.125465 Apr 14 02:57:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 31/87] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 02:57:46 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4ef13ea5-5201-42bc-b8d7-05cb3f0343f6 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b1041f0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-75ad6079-edf9-4219-b4a1-53fea34486bc tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Action: 'create', calling method: .version_select at 0x7ff11b162a70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1544247847", "metadata": {"Type": "work"}}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-75ad6079-edf9-4219-b4a1-53fea34486bc tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Request method failure captured: Apr 14 02:57:46 user devstack@n-api.service[61662]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 02:57:46 user devstack@n-api.service[61662]: Accept: application/json Apr 14 02:57:46 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 02:57:46 user devstack@n-api.service[61662]: Connection: close Apr 14 02:57:46 user devstack@n-api.service[61662]: Content-Length: 120 Apr 14 02:57:46 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 02:57:46 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 02:57:46 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 02:57:46 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEpJlJoffg1Aau2OzIjwsbC-ZUD5SrUCN-_-1zHgvRx0dJaApwtinRE55SmFkf4M80Ys05k3VOBGqXVeL58biKtNkNDAntBpdswGU7hKW8JDEjKiBITcA8DeCFwB7v1j70Vy7SyuAzNy2VZ4sxIVzmTlbuynYxALRd8bYB0GIsO0N8 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c4b9e75f975e4067a2fd38d46941384b"}]}] Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Tenant: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Tenant-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Id: 64585225cdb44ab3b36cb391bf5b4df1 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Name: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61662]: Apr 14 02:57:46 user devstack@n-api.service[61662]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1544247847", "metadata": {"Type": "work"}}} Apr 14 02:57:46 user devstack@n-api.service[61662]: method: Apr 14 02:57:46 user devstack@n-api.service[61662]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 02:57:46 user devstack@n-api.service[61662]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1544247847', 'metadata': {'Type': 'work'}}}} Apr 14 02:57:46 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise error Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi '0' Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-75ad6079-edf9-4219-b4a1-53fea34486bc tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-75ad6079-edf9-4219-b4a1-53fea34486bc tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011283 Apr 14 02:57:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 28/88] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 02:57:46 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d75d6de3-6221-47e7-8a01-0ee0b616fc57 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Action: 'create', calling method: .version_select at 0x7ff11bcc1a20>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1939609583", "metadata": {"Type": "work"}}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d75d6de3-6221-47e7-8a01-0ee0b616fc57 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Request method failure captured: Apr 14 02:57:46 user devstack@n-api.service[61663]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 02:57:46 user devstack@n-api.service[61663]: Accept: application/json Apr 14 02:57:46 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 02:57:46 user devstack@n-api.service[61663]: Connection: close Apr 14 02:57:46 user devstack@n-api.service[61663]: Content-Length: 119 Apr 14 02:57:46 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 02:57:46 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 02:57:46 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 02:57:46 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMEpJlJoffg1Aau2OzIjwsbC-ZUD5SrUCN-_-1zHgvRx0dJaApwtinRE55SmFkf4M80Ys05k3VOBGqXVeL58biKtNkNDAntBpdswGU7hKW8JDEjKiBITcA8DeCFwB7v1j70Vy7SyuAzNy2VZ4sxIVzmTlbuynYxALRd8bYB0GIsO0N8 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c4b9e75f975e4067a2fd38d46941384b"}]}] Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Tenant-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Id: 64585225cdb44ab3b36cb391bf5b4df1 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61663]: Apr 14 02:57:46 user devstack@n-api.service[61663]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1939609583", "metadata": {"Type": "work"}}} Apr 14 02:57:46 user devstack@n-api.service[61663]: method: Apr 14 02:57:46 user devstack@n-api.service[61663]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 02:57:46 user devstack@n-api.service[61663]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1939609583', 'metadata': {'Type': 'work'}}}} Apr 14 02:57:46 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise error Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi '' Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d75d6de3-6221-47e7-8a01-0ee0b616fc57 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d75d6de3-6221-47e7-8a01-0ee0b616fc57 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010304 Apr 14 02:57:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 32/89] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 02:57:46 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-077b66e9-04c2-47c1-b61e-23a365232483 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Calling method '.version_select at 0x7ff11b161f30>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4ef13ea5-5201-42bc-b8d7-05cb3f0343f6 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602" status: 200 len: 344 microversion: 2.1 time: 0.067709 Apr 14 02:57:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 30/90] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:46 2023] GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-077b66e9-04c2-47c1-b61e-23a365232483 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] HTTP exception thrown: Volume tempest-invalid-951955704 could not be found. Apr 14 02:57:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-077b66e9-04c2-47c1-b61e-23a365232483 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Request method failure captured: Apr 14 02:57:46 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-951955704 HTTP/1.1 Apr 14 02:57:46 user devstack@n-api.service[61662]: Accept: application/json Apr 14 02:57:46 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 02:57:46 user devstack@n-api.service[61662]: Connection: close Apr 14 02:57:46 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 02:57:46 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 02:57:46 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 02:57:46 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 02:57:46 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEpJlJoffg1Aau2OzIjwsbC-ZUD5SrUCN-_-1zHgvRx0dJaApwtinRE55SmFkf4M80Ys05k3VOBGqXVeL58biKtNkNDAntBpdswGU7hKW8JDEjKiBITcA8DeCFwB7v1j70Vy7SyuAzNy2VZ4sxIVzmTlbuynYxALRd8bYB0GIsO0N8 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c4b9e75f975e4067a2fd38d46941384b"}]}] Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Tenant: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Tenant-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Id: 64585225cdb44ab3b36cb391bf5b4df1 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Name: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61662]: method: Apr 14 02:57:46 user devstack@n-api.service[61662]: exception: Volume tempest-invalid-951955704 could not be found. Apr 14 02:57:46 user devstack@n-api.service[61662]: action_args: {'id': 'tempest-invalid-951955704'} Apr 14 02:57:46 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-951955704 could not be found. (HTTP 404) (Request-ID: req-8c6a5f21-f3b0-4027-bae5-45aa574f356e) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-951955704 could not be found. Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-951955704 could not be found. Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-951955704 could not be found. Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-077b66e9-04c2-47c1-b61e-23a365232483 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Returning 404 to user: Volume tempest-invalid-951955704 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-077b66e9-04c2-47c1-b61e-23a365232483 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-951955704" status: 404 len: 98 microversion: 2.1 time: 0.039603 Apr 14 02:57:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 29/91] 10.0.0.210 () {62 vars in 1292 bytes} [Fri Apr 14 02:57:46 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-951955704 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0ece15a1-1f1a-4114-beec-66b515fc5536 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004917 Apr 14 02:57:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 33/92] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 02:57:46 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-63969cd8-1327-4b66-9f19-4c8973527cbe tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003620 Apr 14 02:57:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 31/93] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 02:57:46 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a5b1c9ca-0ea7-4d00-b895-f89877733b17 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Calling method '.version_select at 0x7ff11b00c8b0>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-a5b1c9ca-0ea7-4d00-b895-f89877733b17 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] HTTP exception thrown: Volume a3d7b04a-6689-4c40-9bc7-3b09fe03805b could not be found. Apr 14 02:57:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a5b1c9ca-0ea7-4d00-b895-f89877733b17 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Request method failure captured: Apr 14 02:57:46 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/os-volumes/a3d7b04a-6689-4c40-9bc7-3b09fe03805b HTTP/1.1 Apr 14 02:57:46 user devstack@n-api.service[61662]: Accept: application/json Apr 14 02:57:46 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 02:57:46 user devstack@n-api.service[61662]: Connection: close Apr 14 02:57:46 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 02:57:46 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 02:57:46 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 02:57:46 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 02:57:46 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEpJlJoffg1Aau2OzIjwsbC-ZUD5SrUCN-_-1zHgvRx0dJaApwtinRE55SmFkf4M80Ys05k3VOBGqXVeL58biKtNkNDAntBpdswGU7hKW8JDEjKiBITcA8DeCFwB7v1j70Vy7SyuAzNy2VZ4sxIVzmTlbuynYxALRd8bYB0GIsO0N8 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Project-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c4b9e75f975e4067a2fd38d46941384b"}]}] Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Tenant: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Tenant-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Id: 64585225cdb44ab3b36cb391bf5b4df1 Apr 14 02:57:46 user devstack@n-api.service[61662]: X-User-Name: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61662]: method: Apr 14 02:57:46 user devstack@n-api.service[61662]: exception: Volume a3d7b04a-6689-4c40-9bc7-3b09fe03805b could not be found. Apr 14 02:57:46 user devstack@n-api.service[61662]: action_args: {'id': 'a3d7b04a-6689-4c40-9bc7-3b09fe03805b'} Apr 14 02:57:46 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3d7b04a-6689-4c40-9bc7-3b09fe03805b could not be found. (HTTP 404) (Request-ID: req-6b375c0f-2fad-4e15-aabd-576b7052aae1) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3d7b04a-6689-4c40-9bc7-3b09fe03805b could not be found. Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3d7b04a-6689-4c40-9bc7-3b09fe03805b could not be found. Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3d7b04a-6689-4c40-9bc7-3b09fe03805b could not be found. Apr 14 02:57:46 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a5b1c9ca-0ea7-4d00-b895-f89877733b17 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Returning 404 to user: Volume a3d7b04a-6689-4c40-9bc7-3b09fe03805b could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a5b1c9ca-0ea7-4d00-b895-f89877733b17 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/a3d7b04a-6689-4c40-9bc7-3b09fe03805b" status: 404 len: 109 microversion: 2.1 time: 0.042709 Apr 14 02:57:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 30/94] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 02:57:46 2023] DELETE /compute/v2.1/os-volumes/a3d7b04a-6689-4c40-9bc7-3b09fe03805b => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:57:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1f9f70b9-0d8b-4f0a-adf8-3f49c5c23163 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Calling method '.version_select at 0x7ff11b121cf0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-1f9f70b9-0d8b-4f0a-adf8-3f49c5c23163 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] HTTP exception thrown: Volume 342cab75-c702-4715-b7a5-f84443db6d2f could not be found. Apr 14 02:57:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1f9f70b9-0d8b-4f0a-adf8-3f49c5c23163 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Request method failure captured: Apr 14 02:57:46 user devstack@n-api.service[61663]: request: GET /compute/v2.1/os-volumes/342cab75-c702-4715-b7a5-f84443db6d2f HTTP/1.1 Apr 14 02:57:46 user devstack@n-api.service[61663]: Accept: application/json Apr 14 02:57:46 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 02:57:46 user devstack@n-api.service[61663]: Connection: close Apr 14 02:57:46 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 02:57:46 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 02:57:46 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 02:57:46 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 02:57:46 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMEpJlJoffg1Aau2OzIjwsbC-ZUD5SrUCN-_-1zHgvRx0dJaApwtinRE55SmFkf4M80Ys05k3VOBGqXVeL58biKtNkNDAntBpdswGU7hKW8JDEjKiBITcA8DeCFwB7v1j70Vy7SyuAzNy2VZ4sxIVzmTlbuynYxALRd8bYB0GIsO0N8 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4b9e75f975e4067a2fd38d46941384b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c4b9e75f975e4067a2fd38d46941384b"}]}] Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Tenant-Id: c4b9e75f975e4067a2fd38d46941384b Apr 14 02:57:46 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesNegativeTest-1688750533 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Id: 64585225cdb44ab3b36cb391bf5b4df1 Apr 14 02:57:46 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesNegativeTest-1688750533-project-member Apr 14 02:57:46 user devstack@n-api.service[61663]: method: Apr 14 02:57:46 user devstack@n-api.service[61663]: exception: Volume 342cab75-c702-4715-b7a5-f84443db6d2f could not be found. Apr 14 02:57:46 user devstack@n-api.service[61663]: action_args: {'id': '342cab75-c702-4715-b7a5-f84443db6d2f'} Apr 14 02:57:46 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 342cab75-c702-4715-b7a5-f84443db6d2f could not be found. (HTTP 404) (Request-ID: req-b6b23612-1f68-4ba0-9e06-998b4ee96d1a) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 342cab75-c702-4715-b7a5-f84443db6d2f could not be found. Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 342cab75-c702-4715-b7a5-f84443db6d2f could not be found. Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 342cab75-c702-4715-b7a5-f84443db6d2f could not be found. Apr 14 02:57:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1f9f70b9-0d8b-4f0a-adf8-3f49c5c23163 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] Returning 404 to user: Volume 342cab75-c702-4715-b7a5-f84443db6d2f could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1f9f70b9-0d8b-4f0a-adf8-3f49c5c23163 tempest-VolumesNegativeTest-1688750533 tempest-VolumesNegativeTest-1688750533-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/342cab75-c702-4715-b7a5-f84443db6d2f" status: 404 len: 109 microversion: 2.1 time: 0.037274 Apr 14 02:57:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 34/95] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:46 2023] GET /compute/v2.1/os-volumes/342cab75-c702-4715-b7a5-f84443db6d2f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:57:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a8b571d9-3406-41e9-8ccc-83c3f2b0b220 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b105360>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a8b571d9-3406-41e9-8ccc-83c3f2b0b220 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602" status: 200 len: 344 microversion: 2.1 time: 0.059717 Apr 14 02:57:47 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 32/96] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:47 2023] GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:47 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-934222543", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "47266f26-ea7c-404a-9098-264e4a1e0ab6"}]}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:47 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] validate_networks() for [('47266f26-ea7c-404a-9098-264e4a1e0ab6', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:57:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e4b0b132-1622-4456-a0ac-dfe84c3d12d4 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b121ab0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e4b0b132-1622-4456-a0ac-dfe84c3d12d4 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602" status: 200 len: 344 microversion: 2.1 time: 0.061599 Apr 14 02:57:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 35/97] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:48 2023] GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Getting quotas for project f021342634dd4f16bf2720533070154c. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Getting quotas for user 0dbce21e767a4a61b9213e38523d247e and project f021342634dd4f16bf2720533070154c. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:57:48 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:57:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-360cfb37-5a85-4da7-a5d9-a8b0ad63b6aa tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.629596 Apr 14 02:57:49 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 31/98] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:57:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:57:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f3d3b4e1-0f07-423a-8c02-7c5676601b59 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f3d3b4e1-0f07-423a-8c02-7c5676601b59 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:57:49 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-f3d3b4e1-0f07-423a-8c02-7c5676601b59 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbce21e767a4a61b9213e38523d247e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021342634dd4f16bf2720533070154c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:57:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f3d3b4e1-0f07-423a-8c02-7c5676601b59 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b" status: 200 len: 1210 microversion: 2.1 time: 0.354550 Apr 14 02:57:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:57:49 2023] GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b => generated 1210 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:57:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3ea0a0d6-975e-4e21-9135-1ca6a26b3ba5 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b120790>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-3ea0a0d6-975e-4e21-9135-1ca6a26b3ba5 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] HTTP exception thrown: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3ea0a0d6-975e-4e21-9135-1ca6a26b3ba5 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Request method failure captured: Apr 14 02:57:49 user devstack@n-api.service[61663]: request: GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 HTTP/1.1 Apr 14 02:57:49 user devstack@n-api.service[61663]: Accept: application/json Apr 14 02:57:49 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 02:57:49 user devstack@n-api.service[61663]: Connection: close Apr 14 02:57:49 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 02:57:49 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 02:57:49 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 02:57:49 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 02:57:49 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMEc5TqNskULGclzvOaKsk0TJem7nQjXihzXXCjZpBNxctoQC-N050bn4xchQnFCDFPrR7YvsJGVAH3hHNElgiczv6NQXGyJWFz92DmudrNrEx3RcU1qtpO8p3ye8yIJIgwGgwyZ6ankf5WgwnuSfOGrTQwt7gAk80npgHQm7NDHgmU Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Project-Id: cb86fd9df08a4b1c805d5a73291c003c Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb86fd9df08a4b1c805d5a73291c003c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb86fd9df08a4b1c805d5a73291c003c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb86fd9df08a4b1c805d5a73291c003c"}]}] Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Tenant-Id: cb86fd9df08a4b1c805d5a73291c003c Apr 14 02:57:49 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:49 user devstack@n-api.service[61663]: X-User: tempest-VolumesSnapshotsTestJSON-1239932062-project-member Apr 14 02:57:49 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 02:57:49 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 02:57:49 user devstack@n-api.service[61663]: X-User-Id: 0c2ba1fb92fd4c739939c03115d3affa Apr 14 02:57:49 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1239932062-project-member Apr 14 02:57:49 user devstack@n-api.service[61663]: method: Apr 14 02:57:49 user devstack@n-api.service[61663]: exception: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61663]: action_args: {'id': '25c5361d-3ebe-4ab7-a6ff-857245bed602'} Apr 14 02:57:49 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. (HTTP 404) (Request-ID: req-cf5f4d6c-7b4b-41cd-9b14-5daf3a98c688) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3ea0a0d6-975e-4e21-9135-1ca6a26b3ba5 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Returning 404 to user: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3ea0a0d6-975e-4e21-9135-1ca6a26b3ba5 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602" status: 404 len: 109 microversion: 2.1 time: 0.042346 Apr 14 02:57:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 36/100] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:49 2023] GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:57:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d3fe084e-2050-4036-9718-9ffb1c656e45 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b00c4c0>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-d3fe084e-2050-4036-9718-9ffb1c656e45 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] HTTP exception thrown: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d3fe084e-2050-4036-9718-9ffb1c656e45 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Request method failure captured: Apr 14 02:57:49 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 HTTP/1.1 Apr 14 02:57:49 user devstack@n-api.service[61662]: Accept: application/json Apr 14 02:57:49 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 02:57:49 user devstack@n-api.service[61662]: Connection: close Apr 14 02:57:49 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 02:57:49 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 02:57:49 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 02:57:49 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 02:57:49 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEc5TqNskULGclzvOaKsk0TJem7nQjXihzXXCjZpBNxctoQC-N050bn4xchQnFCDFPrR7YvsJGVAH3hHNElgiczv6NQXGyJWFz92DmudrNrEx3RcU1qtpO8p3ye8yIJIgwGgwyZ6ankf5WgwnuSfOGrTQwt7gAk80npgHQm7NDHgmU Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Project-Id: cb86fd9df08a4b1c805d5a73291c003c Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb86fd9df08a4b1c805d5a73291c003c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb86fd9df08a4b1c805d5a73291c003c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb86fd9df08a4b1c805d5a73291c003c"}]}] Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Tenant-Id: cb86fd9df08a4b1c805d5a73291c003c Apr 14 02:57:49 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:49 user devstack@n-api.service[61662]: X-User: tempest-VolumesSnapshotsTestJSON-1239932062-project-member Apr 14 02:57:49 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 02:57:49 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 02:57:49 user devstack@n-api.service[61662]: X-User-Id: 0c2ba1fb92fd4c739939c03115d3affa Apr 14 02:57:49 user devstack@n-api.service[61662]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1239932062-project-member Apr 14 02:57:49 user devstack@n-api.service[61662]: method: Apr 14 02:57:49 user devstack@n-api.service[61662]: exception: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61662]: action_args: {'id': '25c5361d-3ebe-4ab7-a6ff-857245bed602'} Apr 14 02:57:49 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. (HTTP 404) (Request-ID: req-ee023cb6-2165-413a-a243-79e285d1dc58) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d3fe084e-2050-4036-9718-9ffb1c656e45 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Returning 404 to user: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d3fe084e-2050-4036-9718-9ffb1c656e45 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602" status: 404 len: 109 microversion: 2.1 time: 0.068063 Apr 14 02:57:49 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 32/101] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 02:57:49 2023] DELETE /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:57:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-df84f833-3a00-449c-b6cc-621b2b0d34d1 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Calling method '.version_select at 0x7ff11b106f80>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-df84f833-3a00-449c-b6cc-621b2b0d34d1 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] HTTP exception thrown: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-df84f833-3a00-449c-b6cc-621b2b0d34d1 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Request method failure captured: Apr 14 02:57:49 user devstack@n-api.service[61664]: request: GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 HTTP/1.1 Apr 14 02:57:49 user devstack@n-api.service[61664]: Accept: application/json Apr 14 02:57:49 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 02:57:49 user devstack@n-api.service[61664]: Connection: close Apr 14 02:57:49 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 02:57:49 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 02:57:49 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 02:57:49 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 02:57:49 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEc5TqNskULGclzvOaKsk0TJem7nQjXihzXXCjZpBNxctoQC-N050bn4xchQnFCDFPrR7YvsJGVAH3hHNElgiczv6NQXGyJWFz92DmudrNrEx3RcU1qtpO8p3ye8yIJIgwGgwyZ6ankf5WgwnuSfOGrTQwt7gAk80npgHQm7NDHgmU Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Project-Id: cb86fd9df08a4b1c805d5a73291c003c Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb86fd9df08a4b1c805d5a73291c003c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb86fd9df08a4b1c805d5a73291c003c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb86fd9df08a4b1c805d5a73291c003c"}]}] Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Tenant-Id: cb86fd9df08a4b1c805d5a73291c003c Apr 14 02:57:49 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1239932062 Apr 14 02:57:49 user devstack@n-api.service[61664]: X-User: tempest-VolumesSnapshotsTestJSON-1239932062-project-member Apr 14 02:57:49 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 02:57:49 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 02:57:49 user devstack@n-api.service[61664]: X-User-Id: 0c2ba1fb92fd4c739939c03115d3affa Apr 14 02:57:49 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1239932062-project-member Apr 14 02:57:49 user devstack@n-api.service[61664]: method: Apr 14 02:57:49 user devstack@n-api.service[61664]: exception: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61664]: action_args: {'id': '25c5361d-3ebe-4ab7-a6ff-857245bed602'} Apr 14 02:57:49 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. (HTTP 404) (Request-ID: req-ea550845-dcb2-4572-9306-d4ec1820b182) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. Apr 14 02:57:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 02:57:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-df84f833-3a00-449c-b6cc-621b2b0d34d1 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] Returning 404 to user: Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:57:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-df84f833-3a00-449c-b6cc-621b2b0d34d1 tempest-VolumesSnapshotsTestJSON-1239932062 tempest-VolumesSnapshotsTestJSON-1239932062-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602" status: 404 len: 109 microversion: 2.1 time: 0.047219 Apr 14 02:57:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 34/102] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:57:49 2023] GET /compute/v2.1/os-volumes/25c5361d-3ebe-4ab7-a6ff-857245bed602 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 02:57:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7acb3171-1a64-436e-89ed-9f521a4748f1 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'create', calling method: .version_select at 0x7ff11b120280>, body: {"keypair": {"name": "tempest-keypair-368632906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6y0mvseNBRLhWw4IxRvQ6sM63suvzssGomB2WAhQwXiccO+BpgpoREXX5PCnh6WctOjC8rjVUnY+vy8OsVzTbTpnQ2SqX2vivYxEAAgBe255B5s5TdsyT+Q8Nmdyr13w=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:52 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-7acb3171-1a64-436e-89ed-9f521a4748f1 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:57:52 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-7acb3171-1a64-436e-89ed-9f521a4748f1 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for user 7dea23743ba945c4a9d539b8e277c653 and project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:57:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7acb3171-1a64-436e-89ed-9f521a4748f1 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.528988 Apr 14 02:57:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 37/103] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:57:52 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:52 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1854200462", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "079db793-280b-4ba4-8733-eec1c8591b70"}], "security_groups": [{"name": "tempest-securitygroup--443543742"}], "key_name": "tempest-keypair-1156063861", "user_data": "}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:53 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] validate_networks() for [('079db793-280b-4ba4-8733-eec1c8591b70', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:57:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-846820438", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:53 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] validate_networks() for [('d3496999-3ffc-4589-94fc-0795323a1d70', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Getting quotas for project 130665008cf648cf87467ae2777a9170. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Getting quotas for user d6d78d4991b5493e8893034e91ed407b and project 130665008cf648cf87467ae2777a9170. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:57:54 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:57:54 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-874dc327-6a8f-47eb-9312-04e595bf1f37 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.987294 Apr 14 02:57:54 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 33/104] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:57:52 2023] POST /compute/v2.1/servers => generated 399 bytes in 1989 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:57:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8a4ad005-b661-45ac-a413-402120672cb5 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:54 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-8a4ad005-b661-45ac-a413-402120672cb5 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:57:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-8a4ad005-b661-45ac-a413-402120672cb5 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:57:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8a4ad005-b661-45ac-a413-402120672cb5 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1232 microversion: 2.1 time: 0.182342 Apr 14 02:57:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 38/105] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:57:54 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1232 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Getting quotas for project 558bfd7e1d9049d396381de148b0c4a5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Getting quotas for user d5e8150f1502427fb3148f20354d212e and project 558bfd7e1d9049d396381de148b0c4a5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:57:55 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:57:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-75fddbaa-e056-4e56-9ce0-c76737f7e3f4 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.455360 Apr 14 02:57:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 35/106] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:57:52 2023] POST /compute/v2.1/servers => generated 381 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:57:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-e2ac6d36-b8ee-4db1-8c53-ea6c20fdb6cf tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:55 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-e2ac6d36-b8ee-4db1-8c53-ea6c20fdb6cf tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:57:55 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-e2ac6d36-b8ee-4db1-8c53-ea6c20fdb6cf tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:57:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-e2ac6d36-b8ee-4db1-8c53-ea6c20fdb6cf tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6" status: 200 len: 1215 microversion: 2.1 time: 0.178146 Apr 14 02:57:55 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 34/107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:57:55 2023] GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:57:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1086696024", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:55 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] validate_networks() for [('d3496999-3ffc-4589-94fc-0795323a1d70', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Getting quotas for project 558bfd7e1d9049d396381de148b0c4a5. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Getting quotas for user d5e8150f1502427fb3148f20354d212e and project 558bfd7e1d9049d396381de148b0c4a5. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:57:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: ac032176-63bc-457c-ad53-5b4a854eec34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:57:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e2bb68ae-7cfd-4970-977d-df2358c4cb02 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.082181 Apr 14 02:57:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 39/108] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:57:55 2023] POST /compute/v2.1/servers => generated 381 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:57:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8052e0e8-7517-45e2-840a-90485816097c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:57 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8052e0e8-7517-45e2-840a-90485816097c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: ac032176-63bc-457c-ad53-5b4a854eec34] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:57:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1395552505", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e6bbbad8-4a73-4b93-8464-08be8f6681de"}], "security_groups": [{"name": "tempest-securitygroup--1450832286"}], "key_name": "tempest-keypair-368632906", "user_data": "}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:58 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-8052e0e8-7517-45e2-840a-90485816097c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:57:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8052e0e8-7517-45e2-840a-90485816097c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34" status: 200 len: 1216 microversion: 2.1 time: 0.311900 Apr 14 02:57:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 36/109] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:57:57 2023] GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34 => generated 1216 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-ad1e1bcf-6612-4402-9112-7586b866f3ec req-82d34245-1f74-419b-a487-9cc6405fb571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb18db3-28b0-4886-a680-4c534d31cb6b", "tag": "f52f4b73-b4c4-4bc7-a565-1239a13770f1"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ad1e1bcf-6612-4402-9112-7586b866f3ec req-82d34245-1f74-419b-a487-9cc6405fb571 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ad1e1bcf-6612-4402-9112-7586b866f3ec req-82d34245-1f74-419b-a487-9cc6405fb571 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ad1e1bcf-6612-4402-9112-7586b866f3ec req-82d34245-1f74-419b-a487-9cc6405fb571 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:58 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-ad1e1bcf-6612-4402-9112-7586b866f3ec req-82d34245-1f74-419b-a487-9cc6405fb571 service nova] Creating event network-changed:f52f4b73-b4c4-4bc7-a565-1239a13770f1 for instance 1fb18db3-28b0-4886-a680-4c534d31cb6b on user Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ad1e1bcf-6612-4402-9112-7586b866f3ec req-82d34245-1f74-419b-a487-9cc6405fb571 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61662) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ad1e1bcf-6612-4402-9112-7586b866f3ec req-82d34245-1f74-419b-a487-9cc6405fb571 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61662) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0106085f-a158-4199-92ac-bc6abfffea08 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0106085f-a158-4199-92ac-bc6abfffea08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0106085f-a158-4199-92ac-bc6abfffea08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0106085f-a158-4199-92ac-bc6abfffea08 None None] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0106085f-a158-4199-92ac-bc6abfffea08 None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0106085f-a158-4199-92ac-bc6abfffea08 None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:58 user devstack@n-api.service[61662]: INFO nova.compute.rpcapi [None req-0106085f-a158-4199-92ac-bc6abfffea08 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 02:57:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0106085f-a158-4199-92ac-bc6abfffea08 None None] Releasing lock "compute-rpcapi-router" {{(pid=61662) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 02:57:58 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-0106085f-a158-4199-92ac-bc6abfffea08 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324566 Apr 14 02:57:58 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 35/110] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:57:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:57:58 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] validate_networks() for [('e6bbbad8-4a73-4b93-8464-08be8f6681de', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for user 7dea23743ba945c4a9d539b8e277c653 and project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:57:59 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:57:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5bfca42b-717f-47c5-8479-f20eb4bcbe6f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.221389 Apr 14 02:57:59 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 40/111] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:57:58 2023] POST /compute/v2.1/servers => generated 407 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:57:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b87b66d3-e496-4363-96b5-2561ea37b029 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:57:59 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b87b66d3-e496-4363-96b5-2561ea37b029 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:57:59 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b87b66d3-e496-4363-96b5-2561ea37b029 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:57:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b87b66d3-e496-4363-96b5-2561ea37b029 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1232 microversion: 2.1 time: 0.168406 Apr 14 02:57:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 37/112] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:57:59 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1232 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:58:01 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-d8dd314e-6769-4375-b88d-8f9333e04319 req-b0852546-5337-458f-a96e-8a38e46112f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d8dd314e-6769-4375-b88d-8f9333e04319 req-b0852546-5337-458f-a96e-8a38e46112f3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d8dd314e-6769-4375-b88d-8f9333e04319 req-b0852546-5337-458f-a96e-8a38e46112f3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d8dd314e-6769-4375-b88d-8f9333e04319 req-b0852546-5337-458f-a96e-8a38e46112f3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-d8dd314e-6769-4375-b88d-8f9333e04319 req-b0852546-5337-458f-a96e-8a38e46112f3 service nova] Creating event network-changed:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 02:58:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-d8dd314e-6769-4375-b88d-8f9333e04319 req-b0852546-5337-458f-a96e-8a38e46112f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.260904 Apr 14 02:58:01 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 36/113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-815548039", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "19fce8c0-8eeb-41ff-a4b8-6a7a14163b21"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:02 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] validate_networks() for [('19fce8c0-8eeb-41ff-a4b8-6a7a14163b21', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:58:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-08f77f53-d616-49da-a819-31579f20010d req-ed30c39a-f4a8-4cd9-9985-e915702ca276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac032176-63bc-457c-ad53-5b4a854eec34", "tag": "59fef74f-8c76-4dd5-bc99-311eea495950"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-08f77f53-d616-49da-a819-31579f20010d req-ed30c39a-f4a8-4cd9-9985-e915702ca276 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-08f77f53-d616-49da-a819-31579f20010d req-ed30c39a-f4a8-4cd9-9985-e915702ca276 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-08f77f53-d616-49da-a819-31579f20010d req-ed30c39a-f4a8-4cd9-9985-e915702ca276 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-08f77f53-d616-49da-a819-31579f20010d req-ed30c39a-f4a8-4cd9-9985-e915702ca276 service nova] Creating event network-changed:59fef74f-8c76-4dd5-bc99-311eea495950 for instance ac032176-63bc-457c-ad53-5b4a854eec34 on user Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-08f77f53-d616-49da-a819-31579f20010d req-ed30c39a-f4a8-4cd9-9985-e915702ca276 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61664) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-08f77f53-d616-49da-a819-31579f20010d req-ed30c39a-f4a8-4cd9-9985-e915702ca276 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61664) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7cc132c-bfb2-4a5a-9ce0-c38b0ee558dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7cc132c-bfb2-4a5a-9ce0-c38b0ee558dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7cc132c-bfb2-4a5a-9ce0-c38b0ee558dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7cc132c-bfb2-4a5a-9ce0-c38b0ee558dc None None] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7cc132c-bfb2-4a5a-9ce0-c38b0ee558dc None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7cc132c-bfb2-4a5a-9ce0-c38b0ee558dc None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:04 user devstack@n-api.service[61664]: INFO nova.compute.rpcapi [None req-e7cc132c-bfb2-4a5a-9ce0-c38b0ee558dc None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7cc132c-bfb2-4a5a-9ce0-c38b0ee558dc None None] Releasing lock "compute-rpcapi-router" {{(pid=61664) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 02:58:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e7cc132c-bfb2-4a5a-9ce0-c38b0ee558dc None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127588 Apr 14 02:58:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 38/114] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:04 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-5e3a7dda-7a6b-4579-b3c9-ee896851fcfc req-d397c35a-59ef-4f1a-adfd-f4af067ea700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5e3a7dda-7a6b-4579-b3c9-ee896851fcfc req-d397c35a-59ef-4f1a-adfd-f4af067ea700 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5e3a7dda-7a6b-4579-b3c9-ee896851fcfc req-d397c35a-59ef-4f1a-adfd-f4af067ea700 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5e3a7dda-7a6b-4579-b3c9-ee896851fcfc req-d397c35a-59ef-4f1a-adfd-f4af067ea700 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-5e3a7dda-7a6b-4579-b3c9-ee896851fcfc req-d397c35a-59ef-4f1a-adfd-f4af067ea700 service nova] Creating event network-changed:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 02:58:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-5e3a7dda-7a6b-4579-b3c9-ee896851fcfc req-d397c35a-59ef-4f1a-adfd-f4af067ea700 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130811 Apr 14 02:58:04 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 37/115] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-809c2fa7-4f44-49cd-aa3d-df8b1e8ef4b1 req-69813013-2297-4625-8bbd-66b7062660dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb18db3-28b0-4886-a680-4c534d31cb6b", "name": "network-vif-plugged", "status": "completed", "tag": "f52f4b73-b4c4-4bc7-a565-1239a13770f1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-809c2fa7-4f44-49cd-aa3d-df8b1e8ef4b1 req-69813013-2297-4625-8bbd-66b7062660dd service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-809c2fa7-4f44-49cd-aa3d-df8b1e8ef4b1 req-69813013-2297-4625-8bbd-66b7062660dd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-809c2fa7-4f44-49cd-aa3d-df8b1e8ef4b1 req-69813013-2297-4625-8bbd-66b7062660dd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-809c2fa7-4f44-49cd-aa3d-df8b1e8ef4b1 req-69813013-2297-4625-8bbd-66b7062660dd service nova] Creating event network-vif-plugged:f52f4b73-b4c4-4bc7-a565-1239a13770f1 for instance 1fb18db3-28b0-4886-a680-4c534d31cb6b on user Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-809c2fa7-4f44-49cd-aa3d-df8b1e8ef4b1 req-69813013-2297-4625-8bbd-66b7062660dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052606 Apr 14 02:58:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 39/116] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Getting quotas for project 46cec85cd4364c8eaad6870b92249a56. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Getting quotas for user 70eb1e59ba1342688a8ce4e6ff440f58 and project 46cec85cd4364c8eaad6870b92249a56. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:58:04 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:58:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-57c10d87-f58c-4906-a225-9a698f892272 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.540793 Apr 14 02:58:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 41/117] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:58:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 2543 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:58:04 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-585640fb-3b6c-4ddf-bebb-357e785f3132 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:58:04 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-585640fb-3b6c-4ddf-bebb-357e785f3132 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:58:04 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-585640fb-3b6c-4ddf-bebb-357e785f3132 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70eb1e59ba1342688a8ce4e6ff440f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cec85cd4364c8eaad6870b92249a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:58:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-585640fb-3b6c-4ddf-bebb-357e785f3132 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5" status: 200 len: 1208 microversion: 2.1 time: 0.164586 Apr 14 02:58:04 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 38/118] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:58:04 2023] GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5 => generated 1208 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:58:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-0deb4683-e377-4019-8d3c-404aa1b4ecf3 req-f27a6fcf-205a-4fb2-b621-d1bcdbf31766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}, {"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}, {"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0deb4683-e377-4019-8d3c-404aa1b4ecf3 req-f27a6fcf-205a-4fb2-b621-d1bcdbf31766 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0deb4683-e377-4019-8d3c-404aa1b4ecf3 req-f27a6fcf-205a-4fb2-b621-d1bcdbf31766 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0deb4683-e377-4019-8d3c-404aa1b4ecf3 req-f27a6fcf-205a-4fb2-b621-d1bcdbf31766 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0deb4683-e377-4019-8d3c-404aa1b4ecf3 req-f27a6fcf-205a-4fb2-b621-d1bcdbf31766 service nova] Creating event network-changed:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 02:58:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0deb4683-e377-4019-8d3c-404aa1b4ecf3 req-f27a6fcf-205a-4fb2-b621-d1bcdbf31766 service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 02:58:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0deb4683-e377-4019-8d3c-404aa1b4ecf3 req-f27a6fcf-205a-4fb2-b621-d1bcdbf31766 service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 02:58:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-0deb4683-e377-4019-8d3c-404aa1b4ecf3 req-f27a6fcf-205a-4fb2-b621-d1bcdbf31766 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.034232 Apr 14 02:58:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 40/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:06 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-0cf65505-9140-44d8-9203-9ab813b0e052 req-f678a086-f6b7-49bc-ad6b-dd3a5606b343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb18db3-28b0-4886-a680-4c534d31cb6b", "name": "network-vif-plugged", "status": "completed", "tag": "f52f4b73-b4c4-4bc7-a565-1239a13770f1"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0cf65505-9140-44d8-9203-9ab813b0e052 req-f678a086-f6b7-49bc-ad6b-dd3a5606b343 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0cf65505-9140-44d8-9203-9ab813b0e052 req-f678a086-f6b7-49bc-ad6b-dd3a5606b343 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0cf65505-9140-44d8-9203-9ab813b0e052 req-f678a086-f6b7-49bc-ad6b-dd3a5606b343 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-0cf65505-9140-44d8-9203-9ab813b0e052 req-f678a086-f6b7-49bc-ad6b-dd3a5606b343 service nova] Creating event network-vif-plugged:f52f4b73-b4c4-4bc7-a565-1239a13770f1 for instance 1fb18db3-28b0-4886-a680-4c534d31cb6b on user Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0cf65505-9140-44d8-9203-9ab813b0e052 req-f678a086-f6b7-49bc-ad6b-dd3a5606b343 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61663) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0cf65505-9140-44d8-9203-9ab813b0e052 req-f678a086-f6b7-49bc-ad6b-dd3a5606b343 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61663) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-886dcbea-b677-43f8-b5f6-7d613043a4bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-886dcbea-b677-43f8-b5f6-7d613043a4bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-886dcbea-b677-43f8-b5f6-7d613043a4bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-886dcbea-b677-43f8-b5f6-7d613043a4bd None None] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-886dcbea-b677-43f8-b5f6-7d613043a4bd None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-886dcbea-b677-43f8-b5f6-7d613043a4bd None None] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:06 user devstack@n-api.service[61663]: INFO nova.compute.rpcapi [None req-886dcbea-b677-43f8-b5f6-7d613043a4bd None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 02:58:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-886dcbea-b677-43f8-b5f6-7d613043a4bd None None] Releasing lock "compute-rpcapi-router" {{(pid=61663) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 02:58:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-886dcbea-b677-43f8-b5f6-7d613043a4bd None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264640 Apr 14 02:58:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 42/120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:08 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:09 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-346a5a0b-281c-42fc-8096-b5c9be1c4931 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Action: 'create', calling method: .version_select at 0x7ff11a71c670>, body: {"keypair": {"name": "tempest-keypair-309889138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRjkf56mNaAsNKFgnUHc6YtgNOI11oCC45IpAljzRBHWdlhRZJtff4EnryoIR2UUdedBXj1eNEYfP5CFJHsIuaLL73yA24OQjZOf+7GA5PGlabqvgSGMvLYjqcMcQgnmA=="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:09 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-346a5a0b-281c-42fc-8096-b5c9be1c4931 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Getting quotas for project 94a1eb61159b43228db0d529a5be816d. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:58:09 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-346a5a0b-281c-42fc-8096-b5c9be1c4931 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Getting quotas for user f0d4916eb93c4b3ebbbd2af4b0cdacc1 and project 94a1eb61159b43228db0d529a5be816d. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:58:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9072a6db-5c79-4712-8ea9-f5fa4849ee2e req-c2a33de7-d589-46a6-b497-889b4dfe9c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac032176-63bc-457c-ad53-5b4a854eec34", "name": "network-vif-plugged", "status": "completed", "tag": "59fef74f-8c76-4dd5-bc99-311eea495950"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9072a6db-5c79-4712-8ea9-f5fa4849ee2e req-c2a33de7-d589-46a6-b497-889b4dfe9c9b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:09 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-346a5a0b-281c-42fc-8096-b5c9be1c4931 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.450847 Apr 14 02:58:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9072a6db-5c79-4712-8ea9-f5fa4849ee2e req-c2a33de7-d589-46a6-b497-889b4dfe9c9b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9072a6db-5c79-4712-8ea9-f5fa4849ee2e req-c2a33de7-d589-46a6-b497-889b4dfe9c9b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:09 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 39/121] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:58:08 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9072a6db-5c79-4712-8ea9-f5fa4849ee2e req-c2a33de7-d589-46a6-b497-889b4dfe9c9b service nova] Creating event network-vif-plugged:59fef74f-8c76-4dd5-bc99-311eea495950 for instance ac032176-63bc-457c-ad53-5b4a854eec34 on user Apr 14 02:58:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9072a6db-5c79-4712-8ea9-f5fa4849ee2e req-c2a33de7-d589-46a6-b497-889b4dfe9c9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061683 Apr 14 02:58:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 41/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-36440a39-160e-4da3-964b-66ec49a43015 req-761c3f17-8afa-4bc4-9b3c-8387a8c623e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a9ec77-951b-4394-b555-00a49710acb5", "tag": "35c25a8a-1450-4b7a-8a1f-11c047bb9d27"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-36440a39-160e-4da3-964b-66ec49a43015 req-761c3f17-8afa-4bc4-9b3c-8387a8c623e8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-36440a39-160e-4da3-964b-66ec49a43015 req-761c3f17-8afa-4bc4-9b3c-8387a8c623e8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-36440a39-160e-4da3-964b-66ec49a43015 req-761c3f17-8afa-4bc4-9b3c-8387a8c623e8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-36440a39-160e-4da3-964b-66ec49a43015 req-761c3f17-8afa-4bc4-9b3c-8387a8c623e8 service nova] Creating event network-changed:35c25a8a-1450-4b7a-8a1f-11c047bb9d27 for instance 82a9ec77-951b-4394-b555-00a49710acb5 on user Apr 14 02:58:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-36440a39-160e-4da3-964b-66ec49a43015 req-761c3f17-8afa-4bc4-9b3c-8387a8c623e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062555 Apr 14 02:58:09 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 43/123] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:10 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-3b9bdb67-f86f-46bb-a108-017f91905506 req-3a24881b-3beb-41a1-a0d9-696ae4df8216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-3b9bdb67-f86f-46bb-a108-017f91905506 req-3a24881b-3beb-41a1-a0d9-696ae4df8216 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-3b9bdb67-f86f-46bb-a108-017f91905506 req-3a24881b-3beb-41a1-a0d9-696ae4df8216 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-3b9bdb67-f86f-46bb-a108-017f91905506 req-3a24881b-3beb-41a1-a0d9-696ae4df8216 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-3b9bdb67-f86f-46bb-a108-017f91905506 req-3a24881b-3beb-41a1-a0d9-696ae4df8216 service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 02:58:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-3b9bdb67-f86f-46bb-a108-017f91905506 req-3a24881b-3beb-41a1-a0d9-696ae4df8216 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049252 Apr 14 02:58:10 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 40/124] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:11 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=12 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:11 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9c89dd68-d1c7-456d-a181-b23251d6761a req-16101964-8dde-4aa6-8be7-cfdacac00073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac032176-63bc-457c-ad53-5b4a854eec34", "name": "network-vif-plugged", "status": "completed", "tag": "59fef74f-8c76-4dd5-bc99-311eea495950"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9c89dd68-d1c7-456d-a181-b23251d6761a req-16101964-8dde-4aa6-8be7-cfdacac00073 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9c89dd68-d1c7-456d-a181-b23251d6761a req-16101964-8dde-4aa6-8be7-cfdacac00073 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9c89dd68-d1c7-456d-a181-b23251d6761a req-16101964-8dde-4aa6-8be7-cfdacac00073 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9c89dd68-d1c7-456d-a181-b23251d6761a req-16101964-8dde-4aa6-8be7-cfdacac00073 service nova] Creating event network-vif-plugged:59fef74f-8c76-4dd5-bc99-311eea495950 for instance ac032176-63bc-457c-ad53-5b4a854eec34 on user Apr 14 02:58:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9c89dd68-d1c7-456d-a181-b23251d6761a req-16101964-8dde-4aa6-8be7-cfdacac00073 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071242 Apr 14 02:58:11 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 02:58:11 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-6a6c96e3-fe91-4f8d-8a4c-26e9cccb3c97 req-481946ae-224e-485e-8978-66df5071776d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6a6c96e3-fe91-4f8d-8a4c-26e9cccb3c97 req-481946ae-224e-485e-8978-66df5071776d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6a6c96e3-fe91-4f8d-8a4c-26e9cccb3c97 req-481946ae-224e-485e-8978-66df5071776d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6a6c96e3-fe91-4f8d-8a4c-26e9cccb3c97 req-481946ae-224e-485e-8978-66df5071776d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-6a6c96e3-fe91-4f8d-8a4c-26e9cccb3c97 req-481946ae-224e-485e-8978-66df5071776d service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 02:58:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-6a6c96e3-fe91-4f8d-8a4c-26e9cccb3c97 req-481946ae-224e-485e-8978-66df5071776d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050333 Apr 14 02:58:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 44/126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:13 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-dc46105f-1e14-4a63-97d9-98ee53e77ab8 req-5b1927a1-4377-4b84-aac1-e83084d9a51a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-dc46105f-1e14-4a63-97d9-98ee53e77ab8 req-5b1927a1-4377-4b84-aac1-e83084d9a51a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-dc46105f-1e14-4a63-97d9-98ee53e77ab8 req-5b1927a1-4377-4b84-aac1-e83084d9a51a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-dc46105f-1e14-4a63-97d9-98ee53e77ab8 req-5b1927a1-4377-4b84-aac1-e83084d9a51a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:13 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=15 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:13 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-dc46105f-1e14-4a63-97d9-98ee53e77ab8 req-5b1927a1-4377-4b84-aac1-e83084d9a51a service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 02:58:13 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-dc46105f-1e14-4a63-97d9-98ee53e77ab8 req-5b1927a1-4377-4b84-aac1-e83084d9a51a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075173 Apr 14 02:58:13 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 41/127] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1530771040", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "2b0bbe21-b516-4656-8326-a02e9d0e0d38"}], "security_groups": [{"name": "tempest-securitygroup--1560840324"}], "key_name": "tempest-keypair-309889138", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:14 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c578d502-8a85-40bc-ac7a-0383ab03354d req-2c92bbc5-c54b-45e6-91ab-7794c92c52e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}, {"server_uuid": "82a9ec77-951b-4394-b555-00a49710acb5", "name": "network-vif-plugged", "status": "completed", "tag": "35c25a8a-1450-4b7a-8a1f-11c047bb9d27"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c578d502-8a85-40bc-ac7a-0383ab03354d req-2c92bbc5-c54b-45e6-91ab-7794c92c52e1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c578d502-8a85-40bc-ac7a-0383ab03354d req-2c92bbc5-c54b-45e6-91ab-7794c92c52e1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c578d502-8a85-40bc-ac7a-0383ab03354d req-2c92bbc5-c54b-45e6-91ab-7794c92c52e1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c578d502-8a85-40bc-ac7a-0383ab03354d req-2c92bbc5-c54b-45e6-91ab-7794c92c52e1 service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 02:58:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c578d502-8a85-40bc-ac7a-0383ab03354d req-2c92bbc5-c54b-45e6-91ab-7794c92c52e1 service nova] Creating event network-vif-plugged:35c25a8a-1450-4b7a-8a1f-11c047bb9d27 for instance 82a9ec77-951b-4394-b555-00a49710acb5 on user Apr 14 02:58:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c578d502-8a85-40bc-ac7a-0383ab03354d req-2c92bbc5-c54b-45e6-91ab-7794c92c52e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.179845 Apr 14 02:58:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 45/128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:14 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] validate_networks() for [('2b0bbe21-b516-4656-8326-a02e9d0e0d38', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Getting quotas for project 94a1eb61159b43228db0d529a5be816d. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Getting quotas for user f0d4916eb93c4b3ebbbd2af4b0cdacc1 and project 94a1eb61159b43228db0d529a5be816d. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:58:15 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:58:15 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1b25eb11-e2eb-47b3-88da-e6dd18edfb21 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.459589 Apr 14 02:58:15 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 43/129] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:58:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:58:15 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-72fd7688-e790-4c14-bc71-40fb834d7504 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:58:15 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-72fd7688-e790-4c14-bc71-40fb834d7504 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:58:15 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=8 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:15 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-72fd7688-e790-4c14-bc71-40fb834d7504 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d4916eb93c4b3ebbbd2af4b0cdacc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1eb61159b43228db0d529a5be816d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:58:15 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=25 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-72fd7688-e790-4c14-bc71-40fb834d7504 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5" status: 200 len: 1235 microversion: 2.1 time: 0.329796 Apr 14 02:58:15 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 42/130] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:58:15 2023] GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 => generated 1235 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:58:16 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=24 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-652d88eb-c716-4d87-876f-3d8854dc74c9 req-72d36c9a-c5b0-41e4-972e-f0a7dc53aaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a9ec77-951b-4394-b555-00a49710acb5", "name": "network-vif-plugged", "status": "completed", "tag": "35c25a8a-1450-4b7a-8a1f-11c047bb9d27"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:16 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-652d88eb-c716-4d87-876f-3d8854dc74c9 req-72d36c9a-c5b0-41e4-972e-f0a7dc53aaa3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-652d88eb-c716-4d87-876f-3d8854dc74c9 req-72d36c9a-c5b0-41e4-972e-f0a7dc53aaa3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-652d88eb-c716-4d87-876f-3d8854dc74c9 req-72d36c9a-c5b0-41e4-972e-f0a7dc53aaa3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-652d88eb-c716-4d87-876f-3d8854dc74c9 req-72d36c9a-c5b0-41e4-972e-f0a7dc53aaa3 service nova] Creating event network-vif-plugged:35c25a8a-1450-4b7a-8a1f-11c047bb9d27 for instance 82a9ec77-951b-4394-b555-00a49710acb5 on user Apr 14 02:58:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-652d88eb-c716-4d87-876f-3d8854dc74c9 req-72d36c9a-c5b0-41e4-972e-f0a7dc53aaa3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065269 Apr 14 02:58:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 46/131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-fd7315ca-573b-4497-9420-9c29295d3bd7 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Action: 'create', calling method: .version_select at 0x7ff11b06b910>, body: {"keypair": {"name": "tempest-keypair-1011448847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDssy5+6+IRBX1/1QfIFiEyGurxnrzN7WU7XXH4VDLLVpl+RHIRY6CDaehyIbJeSPxvckSMHVq4L1xERiuNNi3d0vUlx65kRNHjlURIglNALBrmkJXBAu0neUdjagAUNcA=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:20 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:20 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-fd7315ca-573b-4497-9420-9c29295d3bd7 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Getting quotas for project bcbeb4e2fdc1420c98c264aac62340a7. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:58:20 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-fd7315ca-573b-4497-9420-9c29295d3bd7 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Getting quotas for user 9eabf8254cde4d86a1862934ec9b5240 and project bcbeb4e2fdc1420c98c264aac62340a7. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:58:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-fd7315ca-573b-4497-9420-9c29295d3bd7 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.698190 Apr 14 02:58:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 44/132] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:58:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:21 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-1d244dbd-54c4-4a2f-b153-73abc6790d45 req-ccf8b811-8dbe-4b6a-bdba-e5b6e37b0285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5", "tag": "9a41964d-ca86-41d7-8287-1af6e94403b4"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1d244dbd-54c4-4a2f-b153-73abc6790d45 req-ccf8b811-8dbe-4b6a-bdba-e5b6e37b0285 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1d244dbd-54c4-4a2f-b153-73abc6790d45 req-ccf8b811-8dbe-4b6a-bdba-e5b6e37b0285 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1d244dbd-54c4-4a2f-b153-73abc6790d45 req-ccf8b811-8dbe-4b6a-bdba-e5b6e37b0285 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-1d244dbd-54c4-4a2f-b153-73abc6790d45 req-ccf8b811-8dbe-4b6a-bdba-e5b6e37b0285 service nova] Creating event network-changed:9a41964d-ca86-41d7-8287-1af6e94403b4 for instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 on user Apr 14 02:58:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-1d244dbd-54c4-4a2f-b153-73abc6790d45 req-ccf8b811-8dbe-4b6a-bdba-e5b6e37b0285 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055530 Apr 14 02:58:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 43/133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:24 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-860564790", "imageRef": "74dfe7d1-36bb-426b-acac-1fe6efabb7b9", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "1d9a131e-6bb9-4d3d-a203-b988587252f3"}], "security_groups": [{"name": "tempest-securitygroup--1230391505"}], "key_name": "tempest-keypair-1011448847", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:24 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] validate_networks() for [('1d9a131e-6bb9-4d3d-a203-b988587252f3', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Getting quotas for project bcbeb4e2fdc1420c98c264aac62340a7. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Getting quotas for user 9eabf8254cde4d86a1862934ec9b5240 and project bcbeb4e2fdc1420c98c264aac62340a7. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:58:25 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74dfe7d1-36bb-426b-acac-1fe6efabb7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:58:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-840bdffd-3183-425c-8c78-db9e4f34d51f tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.154555 Apr 14 02:58:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 47/134] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:58:24 2023] POST /compute/v2.1/servers => generated 404 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:58:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=16 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0699ede6-0108-4780-b5b5-da29feab16da tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:58:25 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0699ede6-0108-4780-b5b5-da29feab16da tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:58:25 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-a006a6f9-47d9-4dfb-ac31-f473111eb9c1 req-eec01220-d356-4aeb-b1a0-a465c5aa6923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5", "name": "network-vif-plugged", "status": "completed", "tag": "9a41964d-ca86-41d7-8287-1af6e94403b4"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a006a6f9-47d9-4dfb-ac31-f473111eb9c1 req-eec01220-d356-4aeb-b1a0-a465c5aa6923 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a006a6f9-47d9-4dfb-ac31-f473111eb9c1 req-eec01220-d356-4aeb-b1a0-a465c5aa6923 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a006a6f9-47d9-4dfb-ac31-f473111eb9c1 req-eec01220-d356-4aeb-b1a0-a465c5aa6923 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:25 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-a006a6f9-47d9-4dfb-ac31-f473111eb9c1 req-eec01220-d356-4aeb-b1a0-a465c5aa6923 service nova] Creating event network-vif-plugged:9a41964d-ca86-41d7-8287-1af6e94403b4 for instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 on user Apr 14 02:58:25 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-a006a6f9-47d9-4dfb-ac31-f473111eb9c1 req-eec01220-d356-4aeb-b1a0-a465c5aa6923 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110933 Apr 14 02:58:25 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 44/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:25 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-0699ede6-0108-4780-b5b5-da29feab16da tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eabf8254cde4d86a1862934ec9b5240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbeb4e2fdc1420c98c264aac62340a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:58:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0699ede6-0108-4780-b5b5-da29feab16da tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a" status: 200 len: 1239 microversion: 2.1 time: 0.317210 Apr 14 02:58:25 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:58:25 2023] GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a => generated 1239 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:58:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-5a6efb38-7723-4331-8978-c37eaff90083 req-4aa9156d-672d-48c1-9dc9-87b2e9c7c64a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5", "name": "network-vif-plugged", "status": "completed", "tag": "9a41964d-ca86-41d7-8287-1af6e94403b4"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5a6efb38-7723-4331-8978-c37eaff90083 req-4aa9156d-672d-48c1-9dc9-87b2e9c7c64a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5a6efb38-7723-4331-8978-c37eaff90083 req-4aa9156d-672d-48c1-9dc9-87b2e9c7c64a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5a6efb38-7723-4331-8978-c37eaff90083 req-4aa9156d-672d-48c1-9dc9-87b2e9c7c64a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:27 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=21 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5a6efb38-7723-4331-8978-c37eaff90083 req-4aa9156d-672d-48c1-9dc9-87b2e9c7c64a service nova] Creating event network-vif-plugged:9a41964d-ca86-41d7-8287-1af6e94403b4 for instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 on user Apr 14 02:58:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-5a6efb38-7723-4331-8978-c37eaff90083 req-4aa9156d-672d-48c1-9dc9-87b2e9c7c64a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068505 Apr 14 02:58:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 48/137] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-763436ca-678b-47a8-a038-be02b66838bf req-49f2b12d-ad41-4bfc-bef2-50ba1140fd46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e712dfa7-67a4-4459-9446-94fd8785b09a", "tag": "612e6a83-4a68-488b-85d3-c5144d53022c"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-763436ca-678b-47a8-a038-be02b66838bf req-49f2b12d-ad41-4bfc-bef2-50ba1140fd46 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-763436ca-678b-47a8-a038-be02b66838bf req-49f2b12d-ad41-4bfc-bef2-50ba1140fd46 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-763436ca-678b-47a8-a038-be02b66838bf req-49f2b12d-ad41-4bfc-bef2-50ba1140fd46 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-763436ca-678b-47a8-a038-be02b66838bf req-49f2b12d-ad41-4bfc-bef2-50ba1140fd46 service nova] Creating event network-changed:612e6a83-4a68-488b-85d3-c5144d53022c for instance e712dfa7-67a4-4459-9446-94fd8785b09a on user Apr 14 02:58:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-763436ca-678b-47a8-a038-be02b66838bf req-49f2b12d-ad41-4bfc-bef2-50ba1140fd46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055341 Apr 14 02:58:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 45/138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-28e79782-d4bb-4331-b882-86a78c1c6611 req-bd041173-c04a-494d-a28d-59bec0c99b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e712dfa7-67a4-4459-9446-94fd8785b09a", "name": "network-vif-plugged", "status": "completed", "tag": "612e6a83-4a68-488b-85d3-c5144d53022c"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-28e79782-d4bb-4331-b882-86a78c1c6611 req-bd041173-c04a-494d-a28d-59bec0c99b9f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-28e79782-d4bb-4331-b882-86a78c1c6611 req-bd041173-c04a-494d-a28d-59bec0c99b9f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-28e79782-d4bb-4331-b882-86a78c1c6611 req-bd041173-c04a-494d-a28d-59bec0c99b9f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-28e79782-d4bb-4331-b882-86a78c1c6611 req-bd041173-c04a-494d-a28d-59bec0c99b9f service nova] Creating event network-vif-plugged:612e6a83-4a68-488b-85d3-c5144d53022c for instance e712dfa7-67a4-4459-9446-94fd8785b09a on user Apr 14 02:58:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-28e79782-d4bb-4331-b882-86a78c1c6611 req-bd041173-c04a-494d-a28d-59bec0c99b9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113410 Apr 14 02:58:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:37 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:37 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ef641b16-af5a-4857-8d28-44b1e29e9338 req-e28db039-f547-42b9-8de0-737535b616b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e712dfa7-67a4-4459-9446-94fd8785b09a", "name": "network-vif-plugged", "status": "completed", "tag": "612e6a83-4a68-488b-85d3-c5144d53022c"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:58:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ef641b16-af5a-4857-8d28-44b1e29e9338 req-e28db039-f547-42b9-8de0-737535b616b2 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ef641b16-af5a-4857-8d28-44b1e29e9338 req-e28db039-f547-42b9-8de0-737535b616b2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ef641b16-af5a-4857-8d28-44b1e29e9338 req-e28db039-f547-42b9-8de0-737535b616b2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ef641b16-af5a-4857-8d28-44b1e29e9338 req-e28db039-f547-42b9-8de0-737535b616b2 service nova] Creating event network-vif-plugged:612e6a83-4a68-488b-85d3-c5144d53022c for instance e712dfa7-67a4-4459-9446-94fd8785b09a on user Apr 14 02:58:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ef641b16-af5a-4857-8d28-44b1e29e9338 req-e28db039-f547-42b9-8de0-737535b616b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041192 Apr 14 02:58:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 49/140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:58:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:58:39 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:39 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-8775bbad-9f3a-49d5-827a-a0264beed090 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:58:39 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-8775bbad-9f3a-49d5-827a-a0264beed090 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:58:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8775bbad-9f3a-49d5-827a-a0264beed090 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8775bbad-9f3a-49d5-827a-a0264beed090 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8775bbad-9f3a-49d5-827a-a0264beed090 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8775bbad-9f3a-49d5-827a-a0264beed090 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8775bbad-9f3a-49d5-827a-a0264beed090 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8775bbad-9f3a-49d5-827a-a0264beed090 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:39 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-8775bbad-9f3a-49d5-827a-a0264beed090 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbce21e767a4a61b9213e38523d247e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021342634dd4f16bf2720533070154c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:58:39 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-8775bbad-9f3a-49d5-827a-a0264beed090 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b" status: 200 len: 1493 microversion: 2.1 time: 0.298681 Apr 14 02:58:39 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 46/141] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:58:39 2023] GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b => generated 1493 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 02:58:44 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=12 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ca9364b5-30a6-4897-92a4-7a1af48dc8b6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:58:44 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ca9364b5-30a6-4897-92a4-7a1af48dc8b6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:58:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ca9364b5-30a6-4897-92a4-7a1af48dc8b6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ca9364b5-30a6-4897-92a4-7a1af48dc8b6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ca9364b5-30a6-4897-92a4-7a1af48dc8b6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ca9364b5-30a6-4897-92a4-7a1af48dc8b6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ca9364b5-30a6-4897-92a4-7a1af48dc8b6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ca9364b5-30a6-4897-92a4-7a1af48dc8b6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:45 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-ca9364b5-30a6-4897-92a4-7a1af48dc8b6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:58:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ca9364b5-30a6-4897-92a4-7a1af48dc8b6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1537 microversion: 2.1 time: 0.242600 Apr 14 02:58:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 47/142] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:58:44 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1537 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5cb522f9-92de-4c6a-ba5c-140d4e28c28d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5cb522f9-92de-4c6a-ba5c-140d4e28c28d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: ac032176-63bc-457c-ad53-5b4a854eec34] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5cb522f9-92de-4c6a-ba5c-140d4e28c28d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5cb522f9-92de-4c6a-ba5c-140d4e28c28d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5cb522f9-92de-4c6a-ba5c-140d4e28c28d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5cb522f9-92de-4c6a-ba5c-140d4e28c28d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5cb522f9-92de-4c6a-ba5c-140d4e28c28d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5cb522f9-92de-4c6a-ba5c-140d4e28c28d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:48 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-5cb522f9-92de-4c6a-ba5c-140d4e28c28d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:58:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5cb522f9-92de-4c6a-ba5c-140d4e28c28d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34" status: 200 len: 1503 microversion: 2.1 time: 0.218755 Apr 14 02:58:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 50/143] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:58:48 2023] GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d2af835d-43fb-4e00-8a85-110cdc773750 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d2af835d-43fb-4e00-8a85-110cdc773750 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=11 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2af835d-43fb-4e00-8a85-110cdc773750 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2af835d-43fb-4e00-8a85-110cdc773750 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2af835d-43fb-4e00-8a85-110cdc773750 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2af835d-43fb-4e00-8a85-110cdc773750 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2af835d-43fb-4e00-8a85-110cdc773750 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2af835d-43fb-4e00-8a85-110cdc773750 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=14 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:49 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-d2af835d-43fb-4e00-8a85-110cdc773750 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:58:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d2af835d-43fb-4e00-8a85-110cdc773750 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1538 microversion: 2.1 time: 0.240969 Apr 14 02:58:49 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 47/144] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:58:49 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1538 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:58:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-34562363-f459-41b1-bcc6-93545fdf0150 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:58:54 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-34562363-f459-41b1-bcc6-93545fdf0150 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:58:54 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-34562363-f459-41b1-bcc6-93545fdf0150 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-34562363-f459-41b1-bcc6-93545fdf0150 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-34562363-f459-41b1-bcc6-93545fdf0150 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-34562363-f459-41b1-bcc6-93545fdf0150 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:58:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-34562363-f459-41b1-bcc6-93545fdf0150 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:58:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-34562363-f459-41b1-bcc6-93545fdf0150 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:58:54 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-34562363-f459-41b1-bcc6-93545fdf0150 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70eb1e59ba1342688a8ce4e6ff440f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cec85cd4364c8eaad6870b92249a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:58:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-34562363-f459-41b1-bcc6-93545fdf0150 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5" status: 200 len: 1490 microversion: 2.1 time: 0.184569 Apr 14 02:58:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 48/145] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:58:54 2023] GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5 => generated 1490 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-192eaa42-3d59-4137-8741-d3d43eb312af tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-192eaa42-3d59-4137-8741-d3d43eb312af tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-192eaa42-3d59-4137-8741-d3d43eb312af tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-192eaa42-3d59-4137-8741-d3d43eb312af tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-192eaa42-3d59-4137-8741-d3d43eb312af tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-192eaa42-3d59-4137-8741-d3d43eb312af tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-192eaa42-3d59-4137-8741-d3d43eb312af tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-192eaa42-3d59-4137-8741-d3d43eb312af tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:06 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-192eaa42-3d59-4137-8741-d3d43eb312af tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d4916eb93c4b3ebbbd2af4b0cdacc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1eb61159b43228db0d529a5be816d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:59:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-192eaa42-3d59-4137-8741-d3d43eb312af tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5" status: 200 len: 1546 microversion: 2.1 time: 0.171611 Apr 14 02:59:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 51/146] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:59:06 2023] GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 => generated 1546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c33341ce-8b3c-480a-ae3e-9d1006098528 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c33341ce-8b3c-480a-ae3e-9d1006098528 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=5 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c33341ce-8b3c-480a-ae3e-9d1006098528 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c33341ce-8b3c-480a-ae3e-9d1006098528 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c33341ce-8b3c-480a-ae3e-9d1006098528 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c33341ce-8b3c-480a-ae3e-9d1006098528 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c33341ce-8b3c-480a-ae3e-9d1006098528 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c33341ce-8b3c-480a-ae3e-9d1006098528 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:15 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-c33341ce-8b3c-480a-ae3e-9d1006098528 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eabf8254cde4d86a1862934ec9b5240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbeb4e2fdc1420c98c264aac62340a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:59:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c33341ce-8b3c-480a-ae3e-9d1006098528 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a" status: 200 len: 1549 microversion: 2.1 time: 0.155009 Apr 14 02:59:15 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 48/147] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:59:15 2023] GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:59:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=14 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-06c86cad-47a5-4f84-a110-819bf50f6710 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Action: 'create', calling method: .version_select at 0x7ff11b0c3370>, body: {"keypair": {"name": "tempest-TestStampPattern-1951210375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOvsWjeP7/S815tfdb/cOxId+DiLVdU5d0FX5X3LVhv2hHJTEUDK11dS58p8M2b3SiTe14kIsNXEkLkLz6Nb9uJ4UZw0ejuGhB6i4/LUSktkX9meq382hMjQRuSfxbyUw=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:19 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-06c86cad-47a5-4f84-a110-819bf50f6710 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Getting quotas for project 6371b4c05df843da9b134e12994c1d7a. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:59:19 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-06c86cad-47a5-4f84-a110-819bf50f6710 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Getting quotas for user 337e2d8118324215b5a0baa36a5895b0 and project 6371b4c05df843da9b134e12994c1d7a. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:59:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-06c86cad-47a5-4f84-a110-819bf50f6710 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.230460 Apr 14 02:59:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 49/148] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:59:19 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:23 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:23 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:23 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-491407941", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1951210375", "security_groups": [{"name": "tempest-secgroup-smoke-123551073"}], "networks": [{"uuid": "516bab80-c2e3-4a1c-9181-5eae563a4ae5"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:23 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] validate_networks() for [('516bab80-c2e3-4a1c-9181-5eae563a4ae5', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Getting quotas for project 6371b4c05df843da9b134e12994c1d7a. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Getting quotas for user 337e2d8118324215b5a0baa36a5895b0 and project 6371b4c05df843da9b134e12994c1d7a. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:59:24 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:59:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6a8650fb-a5d9-46c4-8163-dee963af159b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.629461 Apr 14 02:59:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 52/149] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:59:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:59:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-38920a35-fab4-4d6d-b6e9-36a0640f2a2b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:24 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-38920a35-fab4-4d6d-b6e9-36a0640f2a2b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:24 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-38920a35-fab4-4d6d-b6e9-36a0640f2a2b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337e2d8118324215b5a0baa36a5895b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6371b4c05df843da9b134e12994c1d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:59:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-38920a35-fab4-4d6d-b6e9-36a0640f2a2b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28" status: 200 len: 1236 microversion: 2.1 time: 0.083219 Apr 14 02:59:24 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 49/150] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:59:24 2023] GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28 => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:59:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9cf0afe2-bd11-4275-b7e9-8893068d3ac6 req-a32d7f69-2655-4696-b395-b942936304b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca84990-b165-4d0b-a917-307cd8f96f28", "tag": "920aad6f-1d46-48d5-81eb-95ffbc851da0"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9cf0afe2-bd11-4275-b7e9-8893068d3ac6 req-a32d7f69-2655-4696-b395-b942936304b2 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9cf0afe2-bd11-4275-b7e9-8893068d3ac6 req-a32d7f69-2655-4696-b395-b942936304b2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9cf0afe2-bd11-4275-b7e9-8893068d3ac6 req-a32d7f69-2655-4696-b395-b942936304b2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9cf0afe2-bd11-4275-b7e9-8893068d3ac6 req-a32d7f69-2655-4696-b395-b942936304b2 service nova] Creating event network-changed:920aad6f-1d46-48d5-81eb-95ffbc851da0 for instance 2ca84990-b165-4d0b-a917-307cd8f96f28 on user Apr 14 02:59:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9cf0afe2-bd11-4275-b7e9-8893068d3ac6 req-a32d7f69-2655-4696-b395-b942936304b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034375 Apr 14 02:59:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-45039b8f-f51a-456b-a6a2-c1945336cde3 req-d3374465-0ded-40f3-bf5f-7d5214450e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca84990-b165-4d0b-a917-307cd8f96f28", "name": "network-vif-plugged", "status": "completed", "tag": "920aad6f-1d46-48d5-81eb-95ffbc851da0"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-45039b8f-f51a-456b-a6a2-c1945336cde3 req-d3374465-0ded-40f3-bf5f-7d5214450e6b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-45039b8f-f51a-456b-a6a2-c1945336cde3 req-d3374465-0ded-40f3-bf5f-7d5214450e6b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-45039b8f-f51a-456b-a6a2-c1945336cde3 req-d3374465-0ded-40f3-bf5f-7d5214450e6b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-45039b8f-f51a-456b-a6a2-c1945336cde3 req-d3374465-0ded-40f3-bf5f-7d5214450e6b service nova] Creating event network-vif-plugged:920aad6f-1d46-48d5-81eb-95ffbc851da0 for instance 2ca84990-b165-4d0b-a917-307cd8f96f28 on user Apr 14 02:59:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-45039b8f-f51a-456b-a6a2-c1945336cde3 req-d3374465-0ded-40f3-bf5f-7d5214450e6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055362 Apr 14 02:59:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 53/152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:31 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:31 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-7e320338-b83b-40e9-a9c1-9391ba705ab5 req-056a94ab-6854-4851-a8ee-0fcb5f992c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca84990-b165-4d0b-a917-307cd8f96f28", "name": "network-vif-plugged", "status": "completed", "tag": "920aad6f-1d46-48d5-81eb-95ffbc851da0"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-7e320338-b83b-40e9-a9c1-9391ba705ab5 req-056a94ab-6854-4851-a8ee-0fcb5f992c61 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-7e320338-b83b-40e9-a9c1-9391ba705ab5 req-056a94ab-6854-4851-a8ee-0fcb5f992c61 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-7e320338-b83b-40e9-a9c1-9391ba705ab5 req-056a94ab-6854-4851-a8ee-0fcb5f992c61 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:31 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-7e320338-b83b-40e9-a9c1-9391ba705ab5 req-056a94ab-6854-4851-a8ee-0fcb5f992c61 service nova] Creating event network-vif-plugged:920aad6f-1d46-48d5-81eb-95ffbc851da0 for instance 2ca84990-b165-4d0b-a917-307cd8f96f28 on user Apr 14 02:59:31 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-7e320338-b83b-40e9-a9c1-9391ba705ab5 req-056a94ab-6854-4851-a8ee-0fcb5f992c61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060215 Apr 14 02:59:31 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 50/153] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-432581934", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "ce95f5fe-2669-423c-8ac4-9edd6f1c5f54", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ea0f3bca-5794-46e4-a270-53dbe99375bd"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] validate_networks() for [('ea0f3bca-5794-46e4-a270-53dbe99375bd', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for user 60e11b7ab2914209b23bf7a53791da64 and project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:59:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ce95f5fe-2669-423c-8ac4-9edd6f1c5f54',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:59:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-99f03fd2-5b9b-4316-9e40-7059ed19e510 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.541532 Apr 14 02:59:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 51/154] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:59:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:59:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-620e4478-e104-4da2-a762-4f477d13a319 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-620e4478-e104-4da2-a762-4f477d13a319 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:36 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-620e4478-e104-4da2-a762-4f477d13a319 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:59:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-620e4478-e104-4da2-a762-4f477d13a319 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a" status: 200 len: 1051 microversion: 2.1 time: 0.083450 Apr 14 02:59:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 54/155] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:59:36 2023] GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a => generated 1051 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:59:38 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:38 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-b4a5c682-3e37-4847-85b2-a59609a9802c req-ff70c618-6f83-4a61-8644-8b9d73fbba26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc99f782-81c1-4243-8853-5554e5663d0a", "tag": "c75de928-a52a-4a2a-b413-15a2be115846"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b4a5c682-3e37-4847-85b2-a59609a9802c req-ff70c618-6f83-4a61-8644-8b9d73fbba26 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b4a5c682-3e37-4847-85b2-a59609a9802c req-ff70c618-6f83-4a61-8644-8b9d73fbba26 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b4a5c682-3e37-4847-85b2-a59609a9802c req-ff70c618-6f83-4a61-8644-8b9d73fbba26 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:39 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-b4a5c682-3e37-4847-85b2-a59609a9802c req-ff70c618-6f83-4a61-8644-8b9d73fbba26 service nova] Creating event network-changed:c75de928-a52a-4a2a-b413-15a2be115846 for instance bc99f782-81c1-4243-8853-5554e5663d0a on user Apr 14 02:59:39 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-b4a5c682-3e37-4847-85b2-a59609a9802c req-ff70c618-6f83-4a61-8644-8b9d73fbba26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288135 Apr 14 02:59:39 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 51/156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-408869365", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "47266f26-ea7c-404a-9098-264e4a1e0ab6"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:39 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] validate_networks() for [('47266f26-ea7c-404a-9098-264e4a1e0ab6', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Getting quotas for project f021342634dd4f16bf2720533070154c. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Getting quotas for user 0dbce21e767a4a61b9213e38523d247e and project f021342634dd4f16bf2720533070154c. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:59:40 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 8a826438-d96e-4e70-b50e-aca4be008394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:59:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0ebbf1ee-3414-48a7-9e38-99e3fc9bd8cf tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.967291 Apr 14 02:59:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 52/157] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:59:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:59:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bd08d229-b1da-4bd6-bce8-71d4dda201d8 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:40 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-bd08d229-b1da-4bd6-bce8-71d4dda201d8 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 8a826438-d96e-4e70-b50e-aca4be008394] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:40 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:40 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-bd08d229-b1da-4bd6-bce8-71d4dda201d8 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbce21e767a4a61b9213e38523d247e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021342634dd4f16bf2720533070154c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:59:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-bd08d229-b1da-4bd6-bce8-71d4dda201d8 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394" status: 200 len: 1210 microversion: 2.1 time: 0.057548 Apr 14 02:59:40 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 55/158] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:59:40 2023] GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394 => generated 1210 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:59:43 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-d47672aa-509d-4016-a393-bc64e0513863 req-eb2329f2-60a7-40aa-9cf2-060e5b4c9172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a826438-d96e-4e70-b50e-aca4be008394", "tag": "8151f818-904f-472f-b66c-ee41b2c2975e"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d47672aa-509d-4016-a393-bc64e0513863 req-eb2329f2-60a7-40aa-9cf2-060e5b4c9172 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d47672aa-509d-4016-a393-bc64e0513863 req-eb2329f2-60a7-40aa-9cf2-060e5b4c9172 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d47672aa-509d-4016-a393-bc64e0513863 req-eb2329f2-60a7-40aa-9cf2-060e5b4c9172 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-d47672aa-509d-4016-a393-bc64e0513863 req-eb2329f2-60a7-40aa-9cf2-060e5b4c9172 service nova] Creating event network-changed:8151f818-904f-472f-b66c-ee41b2c2975e for instance 8a826438-d96e-4e70-b50e-aca4be008394 on user Apr 14 02:59:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-d47672aa-509d-4016-a393-bc64e0513863 req-eb2329f2-60a7-40aa-9cf2-060e5b4c9172 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033730 Apr 14 02:59:43 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 52/159] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0e8adf1f-1dce-4b9f-9725-8866a00d5165 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:45 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0e8adf1f-1dce-4b9f-9725-8866a00d5165 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0e8adf1f-1dce-4b9f-9725-8866a00d5165 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0e8adf1f-1dce-4b9f-9725-8866a00d5165 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0e8adf1f-1dce-4b9f-9725-8866a00d5165 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0e8adf1f-1dce-4b9f-9725-8866a00d5165 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0e8adf1f-1dce-4b9f-9725-8866a00d5165 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0e8adf1f-1dce-4b9f-9725-8866a00d5165 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0e8adf1f-1dce-4b9f-9725-8866a00d5165 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.146245 Apr 14 02:59:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 53/160] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 02:59:45 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/os-interface => generated 283 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-f439534e-ab85-4c01-b0f0-5595a69454d6 req-c54e2595-7065-4b50-a1fc-a11d146dbd62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a826438-d96e-4e70-b50e-aca4be008394", "name": "network-vif-plugged", "status": "completed", "tag": "8151f818-904f-472f-b66c-ee41b2c2975e"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f439534e-ab85-4c01-b0f0-5595a69454d6 req-c54e2595-7065-4b50-a1fc-a11d146dbd62 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f439534e-ab85-4c01-b0f0-5595a69454d6 req-c54e2595-7065-4b50-a1fc-a11d146dbd62 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f439534e-ab85-4c01-b0f0-5595a69454d6 req-c54e2595-7065-4b50-a1fc-a11d146dbd62 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f439534e-ab85-4c01-b0f0-5595a69454d6 req-c54e2595-7065-4b50-a1fc-a11d146dbd62 service nova] Creating event network-vif-plugged:8151f818-904f-472f-b66c-ee41b2c2975e for instance 8a826438-d96e-4e70-b50e-aca4be008394 on user Apr 14 02:59:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-f439534e-ab85-4c01-b0f0-5595a69454d6 req-c54e2595-7065-4b50-a1fc-a11d146dbd62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036068 Apr 14 02:59:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 56/161] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-39750a2e-6a0d-432a-876f-6ca762b7038d req-c8239cfc-527b-423e-a6a0-1a469d2568b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:46 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=13 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-39750a2e-6a0d-432a-876f-6ca762b7038d req-c8239cfc-527b-423e-a6a0-1a469d2568b2 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-39750a2e-6a0d-432a-876f-6ca762b7038d req-c8239cfc-527b-423e-a6a0-1a469d2568b2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-39750a2e-6a0d-432a-876f-6ca762b7038d req-c8239cfc-527b-423e-a6a0-1a469d2568b2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-39750a2e-6a0d-432a-876f-6ca762b7038d req-c8239cfc-527b-423e-a6a0-1a469d2568b2 service nova] Creating event network-changed:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 02:59:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-39750a2e-6a0d-432a-876f-6ca762b7038d req-c8239cfc-527b-423e-a6a0-1a469d2568b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033363 Apr 14 02:59:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 53/162] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 02:59:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8ff30166-8049-4bbd-a5a7-9ffb28829eae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:46 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8ff30166-8049-4bbd-a5a7-9ffb28829eae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ff30166-8049-4bbd-a5a7-9ffb28829eae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ff30166-8049-4bbd-a5a7-9ffb28829eae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ff30166-8049-4bbd-a5a7-9ffb28829eae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ff30166-8049-4bbd-a5a7-9ffb28829eae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ff30166-8049-4bbd-a5a7-9ffb28829eae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ff30166-8049-4bbd-a5a7-9ffb28829eae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8ff30166-8049-4bbd-a5a7-9ffb28829eae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/ips" status: 200 len: 104 microversion: 2.1 time: 0.036165 Apr 14 02:59:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 02:59:46 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/ips => generated 104 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:47 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-82294257-372c-403b-94c6-5ee0f11baf24 req-a9be5deb-2ef8-4393-a4e6-570bd9f50000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a826438-d96e-4e70-b50e-aca4be008394", "name": "network-vif-plugged", "status": "completed", "tag": "8151f818-904f-472f-b66c-ee41b2c2975e"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-82294257-372c-403b-94c6-5ee0f11baf24 req-a9be5deb-2ef8-4393-a4e6-570bd9f50000 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-82294257-372c-403b-94c6-5ee0f11baf24 req-a9be5deb-2ef8-4393-a4e6-570bd9f50000 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-82294257-372c-403b-94c6-5ee0f11baf24 req-a9be5deb-2ef8-4393-a4e6-570bd9f50000 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-82294257-372c-403b-94c6-5ee0f11baf24 req-a9be5deb-2ef8-4393-a4e6-570bd9f50000 service nova] Creating event network-vif-plugged:8151f818-904f-472f-b66c-ee41b2c2975e for instance 8a826438-d96e-4e70-b50e-aca4be008394 on user Apr 14 02:59:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-82294257-372c-403b-94c6-5ee0f11baf24 req-a9be5deb-2ef8-4393-a4e6-570bd9f50000 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047043 Apr 14 02:59:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 57/164] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:48 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-90a19a10-8af2-42f6-965a-65441998fb19 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:48 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-90a19a10-8af2-42f6-965a-65441998fb19 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: ac032176-63bc-457c-ad53-5b4a854eec34] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-90a19a10-8af2-42f6-965a-65441998fb19 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-90a19a10-8af2-42f6-965a-65441998fb19 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-90a19a10-8af2-42f6-965a-65441998fb19 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-90a19a10-8af2-42f6-965a-65441998fb19 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-90a19a10-8af2-42f6-965a-65441998fb19 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-90a19a10-8af2-42f6-965a-65441998fb19 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:48 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-90a19a10-8af2-42f6-965a-65441998fb19 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lazy-loading 'flavor' on Instance uuid ac032176-63bc-457c-ad53-5b4a854eec34 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:59:48 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-90a19a10-8af2-42f6-965a-65441998fb19 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34/action" status: 200 len: 32 microversion: 2.1 time: 0.259228 Apr 14 02:59:48 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 54/165] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:59:48 2023] POST /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34/action => generated 32 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:59:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-86eecd3a-db55-4c3f-827e-bafe70617f9d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:48 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-86eecd3a-db55-4c3f-827e-bafe70617f9d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: ac032176-63bc-457c-ad53-5b4a854eec34] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86eecd3a-db55-4c3f-827e-bafe70617f9d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86eecd3a-db55-4c3f-827e-bafe70617f9d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86eecd3a-db55-4c3f-827e-bafe70617f9d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86eecd3a-db55-4c3f-827e-bafe70617f9d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86eecd3a-db55-4c3f-827e-bafe70617f9d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86eecd3a-db55-4c3f-827e-bafe70617f9d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:49 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-86eecd3a-db55-4c3f-827e-bafe70617f9d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:59:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-86eecd3a-db55-4c3f-827e-bafe70617f9d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34" status: 200 len: 1509 microversion: 2.1 time: 0.190313 Apr 14 02:59:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 55/166] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:59:48 2023] GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:59:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1ac2d2b-c18f-4958-a86e-fa298a15c9b8"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:49 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-96bef6af-199b-4676-9de3-3a69f03acca1 req-d1203f7e-39e4-4184-a25c-8c9ab0ee1ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac032176-63bc-457c-ad53-5b4a854eec34", "name": "network-vif-unplugged", "status": "completed", "tag": "59fef74f-8c76-4dd5-bc99-311eea495950"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-96bef6af-199b-4676-9de3-3a69f03acca1 req-d1203f7e-39e4-4184-a25c-8c9ab0ee1ab0 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-96bef6af-199b-4676-9de3-3a69f03acca1 req-d1203f7e-39e4-4184-a25c-8c9ab0ee1ab0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-96bef6af-199b-4676-9de3-3a69f03acca1 req-d1203f7e-39e4-4184-a25c-8c9ab0ee1ab0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-96bef6af-199b-4676-9de3-3a69f03acca1 req-d1203f7e-39e4-4184-a25c-8c9ab0ee1ab0 service nova] Creating event network-vif-unplugged:59fef74f-8c76-4dd5-bc99-311eea495950 for instance ac032176-63bc-457c-ad53-5b4a854eec34 on user Apr 14 02:59:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-96bef6af-199b-4676-9de3-3a69f03acca1 req-d1203f7e-39e4-4184-a25c-8c9ab0ee1ab0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035481 Apr 14 02:59:49 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 55/167] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e640ec75-85c1-41e8-be33-258504acfe1f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e640ec75-85c1-41e8-be33-258504acfe1f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:49 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=7 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e640ec75-85c1-41e8-be33-258504acfe1f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e640ec75-85c1-41e8-be33-258504acfe1f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e640ec75-85c1-41e8-be33-258504acfe1f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e640ec75-85c1-41e8-be33-258504acfe1f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e640ec75-85c1-41e8-be33-258504acfe1f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e640ec75-85c1-41e8-be33-258504acfe1f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:50 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=21 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.493609 Apr 14 02:59:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 58/168] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:59:49 2023] POST /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e640ec75-85c1-41e8-be33-258504acfe1f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.275508 Apr 14 02:59:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 56/169] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 02:59:49 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-interface => generated 282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:51 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-98c39dda-0590-486a-b062-7efbdc16b2bc req-d7074c5a-ebb9-4fac-902e-badd3efb0fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-98c39dda-0590-486a-b062-7efbdc16b2bc req-d7074c5a-ebb9-4fac-902e-badd3efb0fe1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-98c39dda-0590-486a-b062-7efbdc16b2bc req-d7074c5a-ebb9-4fac-902e-badd3efb0fe1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-98c39dda-0590-486a-b062-7efbdc16b2bc req-d7074c5a-ebb9-4fac-902e-badd3efb0fe1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:51 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-98c39dda-0590-486a-b062-7efbdc16b2bc req-d7074c5a-ebb9-4fac-902e-badd3efb0fe1 service nova] Creating event network-changed:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 02:59:51 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-98c39dda-0590-486a-b062-7efbdc16b2bc req-d7074c5a-ebb9-4fac-902e-badd3efb0fe1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047454 Apr 14 02:59:51 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 56/170] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-fecb75c1-04bb-4b69-b08e-68c2459b442a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-fecb75c1-04bb-4b69-b08e-68c2459b442a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:51 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fecb75c1-04bb-4b69-b08e-68c2459b442a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fecb75c1-04bb-4b69-b08e-68c2459b442a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fecb75c1-04bb-4b69-b08e-68c2459b442a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fecb75c1-04bb-4b69-b08e-68c2459b442a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fecb75c1-04bb-4b69-b08e-68c2459b442a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fecb75c1-04bb-4b69-b08e-68c2459b442a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:51 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:51 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=12 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a8cdeb0a-8622-4d7b-ae06-25760352a632 req-06e4be0e-2068-45c5-8513-2cdb4d3bd205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac032176-63bc-457c-ad53-5b4a854eec34", "name": "network-vif-plugged", "status": "completed", "tag": "59fef74f-8c76-4dd5-bc99-311eea495950"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a8cdeb0a-8622-4d7b-ae06-25760352a632 req-06e4be0e-2068-45c5-8513-2cdb4d3bd205 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a8cdeb0a-8622-4d7b-ae06-25760352a632 req-06e4be0e-2068-45c5-8513-2cdb4d3bd205 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a8cdeb0a-8622-4d7b-ae06-25760352a632 req-06e4be0e-2068-45c5-8513-2cdb4d3bd205 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a8cdeb0a-8622-4d7b-ae06-25760352a632 req-06e4be0e-2068-45c5-8513-2cdb4d3bd205 service nova] Creating event network-vif-plugged:59fef74f-8c76-4dd5-bc99-311eea495950 for instance ac032176-63bc-457c-ad53-5b4a854eec34 on user Apr 14 02:59:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a8cdeb0a-8622-4d7b-ae06-25760352a632 req-06e4be0e-2068-45c5-8513-2cdb4d3bd205 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041109 Apr 14 02:59:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 57/171] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:51 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-fecb75c1-04bb-4b69-b08e-68c2459b442a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:59:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-fecb75c1-04bb-4b69-b08e-68c2459b442a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1538 microversion: 2.1 time: 0.263598 Apr 14 02:59:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 59/172] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:59:51 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1538 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:59:52 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c741ee2b-5dc6-40eb-abca-28f6685e567b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:52 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c741ee2b-5dc6-40eb-abca-28f6685e567b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c741ee2b-5dc6-40eb-abca-28f6685e567b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c741ee2b-5dc6-40eb-abca-28f6685e567b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c741ee2b-5dc6-40eb-abca-28f6685e567b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c741ee2b-5dc6-40eb-abca-28f6685e567b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c741ee2b-5dc6-40eb-abca-28f6685e567b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c741ee2b-5dc6-40eb-abca-28f6685e567b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:52 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-c741ee2b-5dc6-40eb-abca-28f6685e567b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:59:52 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c741ee2b-5dc6-40eb-abca-28f6685e567b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1538 microversion: 2.1 time: 0.142639 Apr 14 02:59:52 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:59:52 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1538 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:59:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-5fc3e0c8-3778-492f-a08c-8b79a26ca93d req-013a0635-9264-4fb2-91cb-2984f37cfd01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac032176-63bc-457c-ad53-5b4a854eec34", "name": "network-vif-plugged", "status": "completed", "tag": "59fef74f-8c76-4dd5-bc99-311eea495950"}, {"server_uuid": "ac032176-63bc-457c-ad53-5b4a854eec34", "name": "network-vif-plugged", "status": "completed", "tag": "59fef74f-8c76-4dd5-bc99-311eea495950"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5fc3e0c8-3778-492f-a08c-8b79a26ca93d req-013a0635-9264-4fb2-91cb-2984f37cfd01 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5fc3e0c8-3778-492f-a08c-8b79a26ca93d req-013a0635-9264-4fb2-91cb-2984f37cfd01 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5fc3e0c8-3778-492f-a08c-8b79a26ca93d req-013a0635-9264-4fb2-91cb-2984f37cfd01 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5fc3e0c8-3778-492f-a08c-8b79a26ca93d req-013a0635-9264-4fb2-91cb-2984f37cfd01 service nova] Creating event network-vif-plugged:59fef74f-8c76-4dd5-bc99-311eea495950 for instance ac032176-63bc-457c-ad53-5b4a854eec34 on user Apr 14 02:59:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5fc3e0c8-3778-492f-a08c-8b79a26ca93d req-013a0635-9264-4fb2-91cb-2984f37cfd01 service nova] Creating event network-vif-plugged:59fef74f-8c76-4dd5-bc99-311eea495950 for instance ac032176-63bc-457c-ad53-5b4a854eec34 on user Apr 14 02:59:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-5fc3e0c8-3778-492f-a08c-8b79a26ca93d req-013a0635-9264-4fb2-91cb-2984f37cfd01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033274 Apr 14 02:59:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 58/174] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-29cccbc5-c365-4665-986d-162e32a3f271 req-fbf0880b-e131-4213-a3fd-16dc6ab86373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc99f782-81c1-4243-8853-5554e5663d0a", "name": "network-vif-plugged", "status": "completed", "tag": "c75de928-a52a-4a2a-b413-15a2be115846"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-29cccbc5-c365-4665-986d-162e32a3f271 req-fbf0880b-e131-4213-a3fd-16dc6ab86373 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-29cccbc5-c365-4665-986d-162e32a3f271 req-fbf0880b-e131-4213-a3fd-16dc6ab86373 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-29cccbc5-c365-4665-986d-162e32a3f271 req-fbf0880b-e131-4213-a3fd-16dc6ab86373 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-29cccbc5-c365-4665-986d-162e32a3f271 req-fbf0880b-e131-4213-a3fd-16dc6ab86373 service nova] Creating event network-vif-plugged:c75de928-a52a-4a2a-b413-15a2be115846 for instance bc99f782-81c1-4243-8853-5554e5663d0a on user Apr 14 02:59:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-29cccbc5-c365-4665-986d-162e32a3f271 req-fbf0880b-e131-4213-a3fd-16dc6ab86373 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061058 Apr 14 02:59:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 60/175] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-1ad25374-77a2-4f17-960f-bfdc192b4dbc req-a7139a54-8ee7-4e1e-a865-3b76aed06c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc99f782-81c1-4243-8853-5554e5663d0a", "name": "network-vif-plugged", "status": "completed", "tag": "c75de928-a52a-4a2a-b413-15a2be115846"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1ad25374-77a2-4f17-960f-bfdc192b4dbc req-a7139a54-8ee7-4e1e-a865-3b76aed06c6c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1ad25374-77a2-4f17-960f-bfdc192b4dbc req-a7139a54-8ee7-4e1e-a865-3b76aed06c6c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1ad25374-77a2-4f17-960f-bfdc192b4dbc req-a7139a54-8ee7-4e1e-a865-3b76aed06c6c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-1ad25374-77a2-4f17-960f-bfdc192b4dbc req-a7139a54-8ee7-4e1e-a865-3b76aed06c6c service nova] Creating event network-vif-plugged:c75de928-a52a-4a2a-b413-15a2be115846 for instance bc99f782-81c1-4243-8853-5554e5663d0a on user Apr 14 02:59:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-1ad25374-77a2-4f17-960f-bfdc192b4dbc req-a7139a54-8ee7-4e1e-a865-3b76aed06c6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029128 Apr 14 02:59:56 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 58/176] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-982938a8-b635-4c33-bd57-6c2111a7dbb9 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9358de3-07e9-437f-983f-50a585699a89"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:57 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-982938a8-b635-4c33-bd57-6c2111a7dbb9 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-982938a8-b635-4c33-bd57-6c2111a7dbb9 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-982938a8-b635-4c33-bd57-6c2111a7dbb9 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-982938a8-b635-4c33-bd57-6c2111a7dbb9 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-982938a8-b635-4c33-bd57-6c2111a7dbb9 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-982938a8-b635-4c33-bd57-6c2111a7dbb9 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-982938a8-b635-4c33-bd57-6c2111a7dbb9 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b68fdddc-d2b1-4904-9ab5-d2c77f320d8b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b68fdddc-d2b1-4904-9ab5-d2c77f320d8b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b68fdddc-d2b1-4904-9ab5-d2c77f320d8b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b68fdddc-d2b1-4904-9ab5-d2c77f320d8b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-982938a8-b635-4c33-bd57-6c2111a7dbb9 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] 10.0.0.210 "POST /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385332 Apr 14 02:59:57 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 59/177] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:59:57 2023] POST /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:59:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b68fdddc-d2b1-4904-9ab5-d2c77f320d8b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Going to try to stop instance {{(pid=61663) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 02:59:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b68fdddc-d2b1-4904-9ab5-d2c77f320d8b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/action" status: 202 len: 0 microversion: 2.1 time: 0.369249 Apr 14 02:59:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 61/178] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:59:57 2023] POST /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:59:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-5d254129-f4df-4e82-bad9-b89c3b16438c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:59:58 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-5d254129-f4df-4e82-bad9-b89c3b16438c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:59:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5d254129-f4df-4e82-bad9-b89c3b16438c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5d254129-f4df-4e82-bad9-b89c3b16438c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5d254129-f4df-4e82-bad9-b89c3b16438c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5d254129-f4df-4e82-bad9-b89c3b16438c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5d254129-f4df-4e82-bad9-b89c3b16438c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5d254129-f4df-4e82-bad9-b89c3b16438c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:58 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-5d254129-f4df-4e82-bad9-b89c3b16438c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:59:58 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-5d254129-f4df-4e82-bad9-b89c3b16438c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1711 microversion: 2.1 time: 0.169636 Apr 14 02:59:58 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 59/179] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:59:58 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1711 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:59:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-52eb71fd-f7f2-46e4-8203-b36982044a9c req-9cdc589f-f0ec-46cf-ac00-da6984b26afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-unplugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:59:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-52eb71fd-f7f2-46e4-8203-b36982044a9c req-9cdc589f-f0ec-46cf-ac00-da6984b26afa service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:59:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-52eb71fd-f7f2-46e4-8203-b36982044a9c req-9cdc589f-f0ec-46cf-ac00-da6984b26afa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:59:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-52eb71fd-f7f2-46e4-8203-b36982044a9c req-9cdc589f-f0ec-46cf-ac00-da6984b26afa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:59:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-52eb71fd-f7f2-46e4-8203-b36982044a9c req-9cdc589f-f0ec-46cf-ac00-da6984b26afa service nova] Creating event network-vif-unplugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 02:59:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-52eb71fd-f7f2-46e4-8203-b36982044a9c req-9cdc589f-f0ec-46cf-ac00-da6984b26afa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049718 Apr 14 02:59:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 60/180] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:59:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-b8371578-3159-4591-9446-a77dcbe4d746 req-2c19be0d-5111-4d14-85fa-f30c05b696e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b8371578-3159-4591-9446-a77dcbe4d746 req-2c19be0d-5111-4d14-85fa-f30c05b696e1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b8371578-3159-4591-9446-a77dcbe4d746 req-2c19be0d-5111-4d14-85fa-f30c05b696e1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b8371578-3159-4591-9446-a77dcbe4d746 req-2c19be0d-5111-4d14-85fa-f30c05b696e1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-b8371578-3159-4591-9446-a77dcbe4d746 req-2c19be0d-5111-4d14-85fa-f30c05b696e1 service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:00:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-b8371578-3159-4591-9446-a77dcbe4d746 req-2c19be0d-5111-4d14-85fa-f30c05b696e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030162 Apr 14 03:00:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 62/181] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:00:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:05 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:05 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:05 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:05 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:05 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:05 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:05 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:05 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:05 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:05 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:00:05 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5" status: 204 len: 0 microversion: 2.1 time: 0.128791 Apr 14 03:00:05 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 60/182] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:00:05 2023] DELETE /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:00:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8af59c6c-d112-474d-b0da-aaa618d1464f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:05 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8af59c6c-d112-474d-b0da-aaa618d1464f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af59c6c-d112-474d-b0da-aaa618d1464f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af59c6c-d112-474d-b0da-aaa618d1464f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af59c6c-d112-474d-b0da-aaa618d1464f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af59c6c-d112-474d-b0da-aaa618d1464f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af59c6c-d112-474d-b0da-aaa618d1464f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af59c6c-d112-474d-b0da-aaa618d1464f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:05 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-8af59c6c-d112-474d-b0da-aaa618d1464f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70eb1e59ba1342688a8ce4e6ff440f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cec85cd4364c8eaad6870b92249a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:00:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8af59c6c-d112-474d-b0da-aaa618d1464f tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5" status: 200 len: 1542 microversion: 2.1 time: 0.234749 Apr 14 03:00:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 61/183] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:05 2023] GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5 => generated 1542 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:00:05 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a54adc6f-35a2-48cd-9555-487efac507d0 req-f9b2d367-4f59-471c-afd6-3d763ecf41c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a9ec77-951b-4394-b555-00a49710acb5", "name": "network-vif-unplugged", "status": "completed", "tag": "35c25a8a-1450-4b7a-8a1f-11c047bb9d27"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a54adc6f-35a2-48cd-9555-487efac507d0 req-f9b2d367-4f59-471c-afd6-3d763ecf41c4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a54adc6f-35a2-48cd-9555-487efac507d0 req-f9b2d367-4f59-471c-afd6-3d763ecf41c4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a54adc6f-35a2-48cd-9555-487efac507d0 req-f9b2d367-4f59-471c-afd6-3d763ecf41c4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a54adc6f-35a2-48cd-9555-487efac507d0 req-f9b2d367-4f59-471c-afd6-3d763ecf41c4 service nova] Creating event network-vif-unplugged:35c25a8a-1450-4b7a-8a1f-11c047bb9d27 for instance 82a9ec77-951b-4394-b555-00a49710acb5 on user Apr 14 03:00:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a54adc6f-35a2-48cd-9555-487efac507d0 req-f9b2d367-4f59-471c-afd6-3d763ecf41c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036801 Apr 14 03:00:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 63/184] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:00:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:06 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-bf44d20b-7303-4c6c-a304-a00b908e37cf tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:06 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-bf44d20b-7303-4c6c-a304-a00b908e37cf tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf44d20b-7303-4c6c-a304-a00b908e37cf tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf44d20b-7303-4c6c-a304-a00b908e37cf tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf44d20b-7303-4c6c-a304-a00b908e37cf tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf44d20b-7303-4c6c-a304-a00b908e37cf tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf44d20b-7303-4c6c-a304-a00b908e37cf tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf44d20b-7303-4c6c-a304-a00b908e37cf tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:06 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-bf44d20b-7303-4c6c-a304-a00b908e37cf tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.098265 Apr 14 03:00:06 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 61/185] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:00:06 2023] GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-interface => generated 283 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-48521572-930d-4d99-b7b1-6b8162e18526 req-6c2a3cdd-d8c5-4948-b35c-a59cd92dcab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a9ec77-951b-4394-b555-00a49710acb5", "name": "network-vif-plugged", "status": "completed", "tag": "35c25a8a-1450-4b7a-8a1f-11c047bb9d27"}, {"server_uuid": "82a9ec77-951b-4394-b555-00a49710acb5", "name": "network-vif-plugged", "status": "completed", "tag": "35c25a8a-1450-4b7a-8a1f-11c047bb9d27"}, {"server_uuid": "82a9ec77-951b-4394-b555-00a49710acb5", "name": "network-vif-plugged", "status": "completed", "tag": "35c25a8a-1450-4b7a-8a1f-11c047bb9d27"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-48521572-930d-4d99-b7b1-6b8162e18526 req-6c2a3cdd-d8c5-4948-b35c-a59cd92dcab1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-48521572-930d-4d99-b7b1-6b8162e18526 req-6c2a3cdd-d8c5-4948-b35c-a59cd92dcab1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-48521572-930d-4d99-b7b1-6b8162e18526 req-6c2a3cdd-d8c5-4948-b35c-a59cd92dcab1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-48521572-930d-4d99-b7b1-6b8162e18526 req-6c2a3cdd-d8c5-4948-b35c-a59cd92dcab1 service nova] Creating event network-vif-plugged:35c25a8a-1450-4b7a-8a1f-11c047bb9d27 for instance 82a9ec77-951b-4394-b555-00a49710acb5 on user Apr 14 03:00:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-48521572-930d-4d99-b7b1-6b8162e18526 req-6c2a3cdd-d8c5-4948-b35c-a59cd92dcab1 service nova] Creating event network-vif-plugged:35c25a8a-1450-4b7a-8a1f-11c047bb9d27 for instance 82a9ec77-951b-4394-b555-00a49710acb5 on user Apr 14 03:00:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-48521572-930d-4d99-b7b1-6b8162e18526 req-6c2a3cdd-d8c5-4948-b35c-a59cd92dcab1 service nova] Creating event network-vif-plugged:35c25a8a-1450-4b7a-8a1f-11c047bb9d27 for instance 82a9ec77-951b-4394-b555-00a49710acb5 on user Apr 14 03:00:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-48521572-930d-4d99-b7b1-6b8162e18526 req-6c2a3cdd-d8c5-4948-b35c-a59cd92dcab1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037891 Apr 14 03:00:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 62/186] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:00:08 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:10 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-67dfc6f9-b5e5-46c9-9b78-cbdc89b8245d req-dfa49f5d-15bd-4c95-9c5c-c2758f9647aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a9ec77-951b-4394-b555-00a49710acb5", "name": "network-vif-unplugged", "status": "completed", "tag": "35c25a8a-1450-4b7a-8a1f-11c047bb9d27"}, {"name": "network-changed", "server_uuid": "3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5", "tag": "9a41964d-ca86-41d7-8287-1af6e94403b4"}, {"server_uuid": "82a9ec77-951b-4394-b555-00a49710acb5", "name": "network-vif-plugged", "status": "completed", "tag": "35c25a8a-1450-4b7a-8a1f-11c047bb9d27"}, {"server_uuid": "82a9ec77-951b-4394-b555-00a49710acb5", "name": "network-vif-deleted", "tag": "35c25a8a-1450-4b7a-8a1f-11c047bb9d27"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-67dfc6f9-b5e5-46c9-9b78-cbdc89b8245d req-dfa49f5d-15bd-4c95-9c5c-c2758f9647aa service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-67dfc6f9-b5e5-46c9-9b78-cbdc89b8245d req-dfa49f5d-15bd-4c95-9c5c-c2758f9647aa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-67dfc6f9-b5e5-46c9-9b78-cbdc89b8245d req-dfa49f5d-15bd-4c95-9c5c-c2758f9647aa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-67dfc6f9-b5e5-46c9-9b78-cbdc89b8245d req-dfa49f5d-15bd-4c95-9c5c-c2758f9647aa service nova] Creating event network-vif-unplugged:35c25a8a-1450-4b7a-8a1f-11c047bb9d27 for instance 82a9ec77-951b-4394-b555-00a49710acb5 on user Apr 14 03:00:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-67dfc6f9-b5e5-46c9-9b78-cbdc89b8245d req-dfa49f5d-15bd-4c95-9c5c-c2758f9647aa service nova] Creating event network-changed:9a41964d-ca86-41d7-8287-1af6e94403b4 for instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 on user Apr 14 03:00:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-67dfc6f9-b5e5-46c9-9b78-cbdc89b8245d req-dfa49f5d-15bd-4c95-9c5c-c2758f9647aa service nova] Creating event network-vif-plugged:35c25a8a-1450-4b7a-8a1f-11c047bb9d27 for instance 82a9ec77-951b-4394-b555-00a49710acb5 on user Apr 14 03:00:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-67dfc6f9-b5e5-46c9-9b78-cbdc89b8245d req-dfa49f5d-15bd-4c95-9c5c-c2758f9647aa service nova] Creating event network-vif-deleted:35c25a8a-1450-4b7a-8a1f-11c047bb9d27 for instance 82a9ec77-951b-4394-b555-00a49710acb5 on user Apr 14 03:00:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-67dfc6f9-b5e5-46c9-9b78-cbdc89b8245d req-dfa49f5d-15bd-4c95-9c5c-c2758f9647aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 694 microversion: 2.1 time: 0.036425 Apr 14 03:00:10 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 64/187] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:00:10 2023] POST /compute/v2.1/os-server-external-events => generated 694 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:11 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f460826f-ae62-441b-befc-f957a88addab tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c85af65b-ba3d-4e6f-9d4b-0da7c73c091b"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:11 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-f460826f-ae62-441b-befc-f957a88addab tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f460826f-ae62-441b-befc-f957a88addab tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f460826f-ae62-441b-befc-f957a88addab tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f460826f-ae62-441b-befc-f957a88addab tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f460826f-ae62-441b-befc-f957a88addab tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f460826f-ae62-441b-befc-f957a88addab tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f460826f-ae62-441b-befc-f957a88addab tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:11 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f460826f-ae62-441b-befc-f957a88addab tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294622 Apr 14 03:00:11 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 62/188] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:00:10 2023] POST /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-af4f7f39-8ddb-4f5f-9cc2-50d520d21692 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:14 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-af4f7f39-8ddb-4f5f-9cc2-50d520d21692 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-af4f7f39-8ddb-4f5f-9cc2-50d520d21692 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-af4f7f39-8ddb-4f5f-9cc2-50d520d21692 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-af4f7f39-8ddb-4f5f-9cc2-50d520d21692 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-af4f7f39-8ddb-4f5f-9cc2-50d520d21692 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-af4f7f39-8ddb-4f5f-9cc2-50d520d21692 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-af4f7f39-8ddb-4f5f-9cc2-50d520d21692 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:14 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-af4f7f39-8ddb-4f5f-9cc2-50d520d21692 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337e2d8118324215b5a0baa36a5895b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6371b4c05df843da9b134e12994c1d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:00:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-af4f7f39-8ddb-4f5f-9cc2-50d520d21692 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28" status: 200 len: 1537 microversion: 2.1 time: 0.166718 Apr 14 03:00:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:14 2023] GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28 => generated 1537 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:00:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3c57c58f-2c22-4910-b98d-a30f83cba562 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3c57c58f-2c22-4910-b98d-a30f83cba562 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c57c58f-2c22-4910-b98d-a30f83cba562 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c57c58f-2c22-4910-b98d-a30f83cba562 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c57c58f-2c22-4910-b98d-a30f83cba562 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c57c58f-2c22-4910-b98d-a30f83cba562 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c57c58f-2c22-4910-b98d-a30f83cba562 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c57c58f-2c22-4910-b98d-a30f83cba562 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:16 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3c57c58f-2c22-4910-b98d-a30f83cba562 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.108949 Apr 14 03:00:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 65/190] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:00:16 2023] GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-interface => generated 283 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:17 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-593678eb-a744-4351-9a54-a22b9461d2b9 req-32f72a2e-50e3-4d6a-976a-996031c30336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e712dfa7-67a4-4459-9446-94fd8785b09a", "tag": "612e6a83-4a68-488b-85d3-c5144d53022c"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:17 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-593678eb-a744-4351-9a54-a22b9461d2b9 req-32f72a2e-50e3-4d6a-976a-996031c30336 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-593678eb-a744-4351-9a54-a22b9461d2b9 req-32f72a2e-50e3-4d6a-976a-996031c30336 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-593678eb-a744-4351-9a54-a22b9461d2b9 req-32f72a2e-50e3-4d6a-976a-996031c30336 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:17 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-593678eb-a744-4351-9a54-a22b9461d2b9 req-32f72a2e-50e3-4d6a-976a-996031c30336 service nova] Creating event network-changed:612e6a83-4a68-488b-85d3-c5144d53022c for instance e712dfa7-67a4-4459-9446-94fd8785b09a on user Apr 14 03:00:17 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-593678eb-a744-4351-9a54-a22b9461d2b9 req-32f72a2e-50e3-4d6a-976a-996031c30336 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034926 Apr 14 03:00:17 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 63/191] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:00:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "06528e35-2f6a-4ed9-8826-8ebd90053c21"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] HTTP exception thrown: Volume 06528e35-2f6a-4ed9-8826-8ebd90053c21 could not be found. Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Request method failure captured: Apr 14 03:00:19 user devstack@n-api.service[61664]: request: PUT /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments/c85af65b-ba3d-4e6f-9d4b-0da7c73c091b HTTP/1.1 Apr 14 03:00:19 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:00:19 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:00:19 user devstack@n-api.service[61664]: Connection: close Apr 14 03:00:19 user devstack@n-api.service[61664]: Content-Length: 74 Apr 14 03:00:19 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:00:19 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:00:19 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:00:19 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMFA8ByMyuqVnRBOCAj5v4u3WaAtbJyxtaeeauJGicWUTF5rHtW4lEpCeViubYzp-Ba6emhiIwRSTNX3ndAmhym2LGhQ7En9Z5A33v-TAXlkZYof7hoD_KbAs7xRkO6VY2U1_HNVYCS8zExJZc_TiXss-KjKrHCYaaru_M8ZHoUr5jI Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Project-Id: 9e84140dc06645eca8fda16056a8c4af Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesAdminNegativeTest-2070066656 Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Role: admin,reader,member Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Roles: admin,reader,member Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e84140dc06645eca8fda16056a8c4af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e84140dc06645eca8fda16056a8c4af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e84140dc06645eca8fda16056a8c4af"}]}] Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesAdminNegativeTest-2070066656 Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Tenant-Id: 9e84140dc06645eca8fda16056a8c4af Apr 14 03:00:19 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2070066656 Apr 14 03:00:19 user devstack@n-api.service[61664]: X-User: tempest-VolumesAdminNegativeTest-2070066656-project-admin Apr 14 03:00:19 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:00:19 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:00:19 user devstack@n-api.service[61664]: X-User-Id: a5d3018ea16143d98508167b17d3314f Apr 14 03:00:19 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesAdminNegativeTest-2070066656-project-admin Apr 14 03:00:19 user devstack@n-api.service[61664]: Apr 14 03:00:19 user devstack@n-api.service[61664]: {"volumeAttachment": {"volumeId": "06528e35-2f6a-4ed9-8826-8ebd90053c21"}} Apr 14 03:00:19 user devstack@n-api.service[61664]: method: > Apr 14 03:00:19 user devstack@n-api.service[61664]: exception: Volume 06528e35-2f6a-4ed9-8826-8ebd90053c21 could not be found. Apr 14 03:00:19 user devstack@n-api.service[61664]: action_args: {'server_id': '3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5', 'id': 'c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'body': {'volumeAttachment': {'volumeId': '06528e35-2f6a-4ed9-8826-8ebd90053c21'}}} Apr 14 03:00:19 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06528e35-2f6a-4ed9-8826-8ebd90053c21 could not be found. (HTTP 404) (Request-ID: req-41304267-718b-48b4-9008-60afb4a3b402) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06528e35-2f6a-4ed9-8826-8ebd90053c21 could not be found. Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 06528e35-2f6a-4ed9-8826-8ebd90053c21 could not be found. Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06528e35-2f6a-4ed9-8826-8ebd90053c21 could not be found. Apr 14 03:00:19 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Returning 400 to user: Volume 06528e35-2f6a-4ed9-8826-8ebd90053c21 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:00:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5a1b04d2-b1c4-43a9-abfa-23701ae63b81 tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments/c85af65b-ba3d-4e6f-9d4b-0da7c73c091b" status: 400 len: 107 microversion: 2.1 time: 0.329921 Apr 14 03:00:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 64/192] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 03:00:18 2023] PUT /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments/c85af65b-ba3d-4e6f-9d4b-0da7c73c091b => generated 107 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:00:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d14f329d-5bc4-4988-9337-40e04e52fb4d tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d14f329d-5bc4-4988-9337-40e04e52fb4d tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d14f329d-5bc4-4988-9337-40e04e52fb4d tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d14f329d-5bc4-4988-9337-40e04e52fb4d tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d14f329d-5bc4-4988-9337-40e04e52fb4d tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d14f329d-5bc4-4988-9337-40e04e52fb4d tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d14f329d-5bc4-4988-9337-40e04e52fb4d tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d14f329d-5bc4-4988-9337-40e04e52fb4d tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:19 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-d14f329d-5bc4-4988-9337-40e04e52fb4d tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lazy-loading 'services' on Instance uuid 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:00:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d14f329d-5bc4-4988-9337-40e04e52fb4d tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments/c85af65b-ba3d-4e6f-9d4b-0da7c73c091b" status: 202 len: 0 microversion: 2.1 time: 0.248505 Apr 14 03:00:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:00:19 2023] DELETE /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments/c85af65b-ba3d-4e6f-9d4b-0da7c73c091b => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:00:19 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-4695e982-f80c-42fd-9788-949210490a96 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:19 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-4695e982-f80c-42fd-9788-949210490a96 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4695e982-f80c-42fd-9788-949210490a96 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4695e982-f80c-42fd-9788-949210490a96 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4695e982-f80c-42fd-9788-949210490a96 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4695e982-f80c-42fd-9788-949210490a96 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4695e982-f80c-42fd-9788-949210490a96 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4695e982-f80c-42fd-9788-949210490a96 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:19 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-4695e982-f80c-42fd-9788-949210490a96 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043612 Apr 14 03:00:19 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 64/194] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:00:19 2023] GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e898aaea-41c4-4fc9-ac07-5d27f62094c4"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:20 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329150 Apr 14 03:00:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 65/195] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:00:19 2023] POST /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:26 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-79f79d30-1277-4064-aa6b-55a3bd8409bc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:26 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-79f79d30-1277-4064-aa6b-55a3bd8409bc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79f79d30-1277-4064-aa6b-55a3bd8409bc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79f79d30-1277-4064-aa6b-55a3bd8409bc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79f79d30-1277-4064-aa6b-55a3bd8409bc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79f79d30-1277-4064-aa6b-55a3bd8409bc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79f79d30-1277-4064-aa6b-55a3bd8409bc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79f79d30-1277-4064-aa6b-55a3bd8409bc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:26 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3e84291d-8d1b-4a7c-9bcc-01dbf4e03cd3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:26 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3e84291d-8d1b-4a7c-9bcc-01dbf4e03cd3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e84291d-8d1b-4a7c-9bcc-01dbf4e03cd3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e84291d-8d1b-4a7c-9bcc-01dbf4e03cd3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e84291d-8d1b-4a7c-9bcc-01dbf4e03cd3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e84291d-8d1b-4a7c-9bcc-01dbf4e03cd3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e84291d-8d1b-4a7c-9bcc-01dbf4e03cd3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e84291d-8d1b-4a7c-9bcc-01dbf4e03cd3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3e84291d-8d1b-4a7c-9bcc-01dbf4e03cd3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Apr 14 03:00:26 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 65/196] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:00:26 2023] GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a6fe4b60-0ecd-4422-9ede-418ee997e31c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a6fe4b60-0ecd-4422-9ede-418ee997e31c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=20 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6fe4b60-0ecd-4422-9ede-418ee997e31c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6fe4b60-0ecd-4422-9ede-418ee997e31c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6fe4b60-0ecd-4422-9ede-418ee997e31c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6fe4b60-0ecd-4422-9ede-418ee997e31c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6fe4b60-0ecd-4422-9ede-418ee997e31c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6fe4b60-0ecd-4422-9ede-418ee997e31c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:26 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-79f79d30-1277-4064-aa6b-55a3bd8409bc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:00:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-79f79d30-1277-4064-aa6b-55a3bd8409bc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a" status: 200 len: 1379 microversion: 2.1 time: 0.157904 Apr 14 03:00:26 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 67/197] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:26 2023] GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a => generated 1379 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:00:26 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-a6fe4b60-0ecd-4422-9ede-418ee997e31c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lazy-loading 'services' on Instance uuid e712dfa7-67a4-4459-9446-94fd8785b09a {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:00:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a6fe4b60-0ecd-4422-9ede-418ee997e31c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-volume_attachments/e898aaea-41c4-4fc9-ac07-5d27f62094c4" status: 202 len: 0 microversion: 2.1 time: 0.306910 Apr 14 03:00:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 66/198] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:00:26 2023] DELETE /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-volume_attachments/e898aaea-41c4-4fc9-ac07-5d27f62094c4 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3cbde13b-9ca6-4c12-8538-488620b97982 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3cbde13b-9ca6-4c12-8538-488620b97982 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3cbde13b-9ca6-4c12-8538-488620b97982 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3cbde13b-9ca6-4c12-8538-488620b97982 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3cbde13b-9ca6-4c12-8538-488620b97982 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3cbde13b-9ca6-4c12-8538-488620b97982 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3cbde13b-9ca6-4c12-8538-488620b97982 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3cbde13b-9ca6-4c12-8538-488620b97982 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3cbde13b-9ca6-4c12-8538-488620b97982 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044587 Apr 14 03:00:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 66/199] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:00:29 2023] GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-941026ab-e719-4ad8-8c2e-4fcc6d66c950 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-941026ab-e719-4ad8-8c2e-4fcc6d66c950 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=16 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-941026ab-e719-4ad8-8c2e-4fcc6d66c950 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-941026ab-e719-4ad8-8c2e-4fcc6d66c950 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-941026ab-e719-4ad8-8c2e-4fcc6d66c950 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-941026ab-e719-4ad8-8c2e-4fcc6d66c950 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-941026ab-e719-4ad8-8c2e-4fcc6d66c950 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-941026ab-e719-4ad8-8c2e-4fcc6d66c950 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-941026ab-e719-4ad8-8c2e-4fcc6d66c950 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049136 Apr 14 03:00:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 68/200] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:00:29 2023] GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:00:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-cf02401d-4fb7-4ec3-b8fc-53277e38baeb tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:29 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-cf02401d-4fb7-4ec3-b8fc-53277e38baeb tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf02401d-4fb7-4ec3-b8fc-53277e38baeb tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf02401d-4fb7-4ec3-b8fc-53277e38baeb tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf02401d-4fb7-4ec3-b8fc-53277e38baeb tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf02401d-4fb7-4ec3-b8fc-53277e38baeb tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf02401d-4fb7-4ec3-b8fc-53277e38baeb tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf02401d-4fb7-4ec3-b8fc-53277e38baeb tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:29 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-cf02401d-4fb7-4ec3-b8fc-53277e38baeb tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:00:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-cf02401d-4fb7-4ec3-b8fc-53277e38baeb tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a" status: 204 len: 0 microversion: 2.1 time: 0.132312 Apr 14 03:00:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:00:29 2023] DELETE /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3d5a8ce5-127d-47f9-be49-7a16d15a4d01 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3d5a8ce5-127d-47f9-be49-7a16d15a4d01 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d5a8ce5-127d-47f9-be49-7a16d15a4d01 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d5a8ce5-127d-47f9-be49-7a16d15a4d01 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d5a8ce5-127d-47f9-be49-7a16d15a4d01 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d5a8ce5-127d-47f9-be49-7a16d15a4d01 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d5a8ce5-127d-47f9-be49-7a16d15a4d01 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d5a8ce5-127d-47f9-be49-7a16d15a4d01 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:29 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-3d5a8ce5-127d-47f9-be49-7a16d15a4d01 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eabf8254cde4d86a1862934ec9b5240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbeb4e2fdc1420c98c264aac62340a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:00:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3d5a8ce5-127d-47f9-be49-7a16d15a4d01 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a" status: 200 len: 1674 microversion: 2.1 time: 0.162116 Apr 14 03:00:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 67/202] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:29 2023] GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-e4247b67-2235-4cd0-bb30-4c89e21d2515 req-33f27eaf-d98d-4f04-87ba-820624a2f26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e712dfa7-67a4-4459-9446-94fd8785b09a", "name": "network-vif-unplugged", "status": "completed", "tag": "612e6a83-4a68-488b-85d3-c5144d53022c"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e4247b67-2235-4cd0-bb30-4c89e21d2515 req-33f27eaf-d98d-4f04-87ba-820624a2f26c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e4247b67-2235-4cd0-bb30-4c89e21d2515 req-33f27eaf-d98d-4f04-87ba-820624a2f26c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e4247b67-2235-4cd0-bb30-4c89e21d2515 req-33f27eaf-d98d-4f04-87ba-820624a2f26c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e4247b67-2235-4cd0-bb30-4c89e21d2515 req-33f27eaf-d98d-4f04-87ba-820624a2f26c service nova] Creating event network-vif-unplugged:612e6a83-4a68-488b-85d3-c5144d53022c for instance e712dfa7-67a4-4459-9446-94fd8785b09a on user Apr 14 03:00:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-e4247b67-2235-4cd0-bb30-4c89e21d2515 req-33f27eaf-d98d-4f04-87ba-820624a2f26c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033712 Apr 14 03:00:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 69/203] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:00:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e3ccd0cb-2aeb-445f-9a10-f84be7ff3fd3 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:31 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e3ccd0cb-2aeb-445f-9a10-f84be7ff3fd3 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 8a826438-d96e-4e70-b50e-aca4be008394] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e3ccd0cb-2aeb-445f-9a10-f84be7ff3fd3 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e3ccd0cb-2aeb-445f-9a10-f84be7ff3fd3 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e3ccd0cb-2aeb-445f-9a10-f84be7ff3fd3 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e3ccd0cb-2aeb-445f-9a10-f84be7ff3fd3 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e3ccd0cb-2aeb-445f-9a10-f84be7ff3fd3 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e3ccd0cb-2aeb-445f-9a10-f84be7ff3fd3 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:31 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-e3ccd0cb-2aeb-445f-9a10-f84be7ff3fd3 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbce21e767a4a61b9213e38523d247e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021342634dd4f16bf2720533070154c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:00:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e3ccd0cb-2aeb-445f-9a10-f84be7ff3fd3 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394" status: 200 len: 1493 microversion: 2.1 time: 0.156080 Apr 14 03:00:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 68/204] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:31 2023] GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394 => generated 1493 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:00:31 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-9adcf87e-ab63-4fe3-a723-6c4f3fb1e5c8 req-efec54dc-b0a4-43f5-a785-38f155e57455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e712dfa7-67a4-4459-9446-94fd8785b09a", "name": "network-vif-deleted", "tag": "612e6a83-4a68-488b-85d3-c5144d53022c"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9adcf87e-ab63-4fe3-a723-6c4f3fb1e5c8 req-efec54dc-b0a4-43f5-a785-38f155e57455 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9adcf87e-ab63-4fe3-a723-6c4f3fb1e5c8 req-efec54dc-b0a4-43f5-a785-38f155e57455 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9adcf87e-ab63-4fe3-a723-6c4f3fb1e5c8 req-efec54dc-b0a4-43f5-a785-38f155e57455 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:31 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-9adcf87e-ab63-4fe3-a723-6c4f3fb1e5c8 req-efec54dc-b0a4-43f5-a785-38f155e57455 service nova] Creating event network-vif-deleted:612e6a83-4a68-488b-85d3-c5144d53022c for instance e712dfa7-67a4-4459-9446-94fd8785b09a on user Apr 14 03:00:31 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-9adcf87e-ab63-4fe3-a723-6c4f3fb1e5c8 req-efec54dc-b0a4-43f5-a785-38f155e57455 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027951 Apr 14 03:00:31 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 68/205] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:00:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-b085757f-fa83-44fb-aa54-56cd74bca8f5 req-2e9d3624-4c67-4825-ac14-f9456c019b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e712dfa7-67a4-4459-9446-94fd8785b09a", "name": "network-vif-plugged", "status": "completed", "tag": "612e6a83-4a68-488b-85d3-c5144d53022c"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:00:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b085757f-fa83-44fb-aa54-56cd74bca8f5 req-2e9d3624-4c67-4825-ac14-f9456c019b87 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b085757f-fa83-44fb-aa54-56cd74bca8f5 req-2e9d3624-4c67-4825-ac14-f9456c019b87 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b085757f-fa83-44fb-aa54-56cd74bca8f5 req-2e9d3624-4c67-4825-ac14-f9456c019b87 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-b085757f-fa83-44fb-aa54-56cd74bca8f5 req-2e9d3624-4c67-4825-ac14-f9456c019b87 service nova] Creating event network-vif-plugged:612e6a83-4a68-488b-85d3-c5144d53022c for instance e712dfa7-67a4-4459-9446-94fd8785b09a on user Apr 14 03:00:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-b085757f-fa83-44fb-aa54-56cd74bca8f5 req-2e9d3624-4c67-4825-ac14-f9456c019b87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058736 Apr 14 03:00:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 70/206] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:00:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:00:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-02f832b8-b3e1-47bc-a0c1-56981b17b275 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-02f832b8-b3e1-47bc-a0c1-56981b17b275 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: ac032176-63bc-457c-ad53-5b4a854eec34] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-02f832b8-b3e1-47bc-a0c1-56981b17b275 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-02f832b8-b3e1-47bc-a0c1-56981b17b275 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-02f832b8-b3e1-47bc-a0c1-56981b17b275 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-02f832b8-b3e1-47bc-a0c1-56981b17b275 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-02f832b8-b3e1-47bc-a0c1-56981b17b275 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-02f832b8-b3e1-47bc-a0c1-56981b17b275 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:39 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-02f832b8-b3e1-47bc-a0c1-56981b17b275 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:00:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-02f832b8-b3e1-47bc-a0c1-56981b17b275 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34" status: 200 len: 1489 microversion: 2.1 time: 0.170152 Apr 14 03:00:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 69/207] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:39 2023] GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34 => generated 1489 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=11 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-67cb7135-c6f7-418e-aa6a-09cea543ac35 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-67cb7135-c6f7-418e-aa6a-09cea543ac35 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-67cb7135-c6f7-418e-aa6a-09cea543ac35 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-67cb7135-c6f7-418e-aa6a-09cea543ac35 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-67cb7135-c6f7-418e-aa6a-09cea543ac35 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-67cb7135-c6f7-418e-aa6a-09cea543ac35 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-67cb7135-c6f7-418e-aa6a-09cea543ac35 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-67cb7135-c6f7-418e-aa6a-09cea543ac35 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:42 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-67cb7135-c6f7-418e-aa6a-09cea543ac35 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:00:42 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-67cb7135-c6f7-418e-aa6a-09cea543ac35 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1656 microversion: 2.1 time: 0.151741 Apr 14 03:00:42 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 69/208] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:42 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=5 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7d25759a-9afd-4399-b9ed-5d368766262d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7d25759a-9afd-4399-b9ed-5d368766262d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d25759a-9afd-4399-b9ed-5d368766262d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d25759a-9afd-4399-b9ed-5d368766262d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d25759a-9afd-4399-b9ed-5d368766262d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d25759a-9afd-4399-b9ed-5d368766262d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d25759a-9afd-4399-b9ed-5d368766262d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d25759a-9afd-4399-b9ed-5d368766262d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:42 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-7d25759a-9afd-4399-b9ed-5d368766262d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:00:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7d25759a-9afd-4399-b9ed-5d368766262d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1656 microversion: 2.1 time: 0.146878 Apr 14 03:00:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 71/209] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:42 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:00:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8ee24200-e5a8-4e8e-8a6f-8c50e44ba8fb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:48 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8ee24200-e5a8-4e8e-8a6f-8c50e44ba8fb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ee24200-e5a8-4e8e-8a6f-8c50e44ba8fb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ee24200-e5a8-4e8e-8a6f-8c50e44ba8fb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ee24200-e5a8-4e8e-8a6f-8c50e44ba8fb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ee24200-e5a8-4e8e-8a6f-8c50e44ba8fb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ee24200-e5a8-4e8e-8a6f-8c50e44ba8fb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8ee24200-e5a8-4e8e-8a6f-8c50e44ba8fb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:48 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-8ee24200-e5a8-4e8e-8a6f-8c50e44ba8fb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:00:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8ee24200-e5a8-4e8e-8a6f-8c50e44ba8fb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1688 microversion: 2.1 time: 0.148297 Apr 14 03:00:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 70/210] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:48 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] HTTP exception thrown: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Request method failure captured: Apr 14 03:00:56 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5 HTTP/1.1 Apr 14 03:00:56 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:00:56 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:00:56 user devstack@n-api.service[61662]: Connection: close Apr 14 03:00:56 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:00:56 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:00:56 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:00:56 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:00:56 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOME5HYCeirkN8OulnPuNQsWxiJbJ8PIhfdVqfi8LvyWXNORUNtqaIZg9cIY0OXo8yXtIgfFHz45Xn8IqxLoiOvCvSSl6vt-zyZMq9vAaJG2QKGTWWuMSxAkMB7N3iSxZl5K8fi1K8dVdFjJG0PzVdTA-wqXDbxYn2EQbT9Pk76kfw-o Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Project-Id: 46cec85cd4364c8eaad6870b92249a56 Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Project-Name: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46cec85cd4364c8eaad6870b92249a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46cec85cd4364c8eaad6870b92249a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46cec85cd4364c8eaad6870b92249a56"}]}] Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Tenant: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Tenant-Id: 46cec85cd4364c8eaad6870b92249a56 Apr 14 03:00:56 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:56 user devstack@n-api.service[61662]: X-User: tempest-DeleteServersTestJSON-360109579-project-member Apr 14 03:00:56 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:00:56 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:00:56 user devstack@n-api.service[61662]: X-User-Id: 70eb1e59ba1342688a8ce4e6ff440f58 Apr 14 03:00:56 user devstack@n-api.service[61662]: X-User-Name: tempest-DeleteServersTestJSON-360109579-project-member Apr 14 03:00:56 user devstack@n-api.service[61662]: method: > Apr 14 03:00:56 user devstack@n-api.service[61662]: exception: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:56 user devstack@n-api.service[61662]: action_args: {'id': '82a9ec77-951b-4394-b555-00a49710acb5'} Apr 14 03:00:56 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:56 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:00:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Returning 404 to user: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:00:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b2ff2932-286e-46e7-b099-385c9e8e3e30 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5" status: 404 len: 111 microversion: 2.1 time: 0.036928 Apr 14 03:00:56 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 70/211] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:56 2023] GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] HTTP exception thrown: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Request method failure captured: Apr 14 03:00:56 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5/os-volume_attachments HTTP/1.1 Apr 14 03:00:56 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:00:56 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:00:56 user devstack@n-api.service[61663]: Connection: close Apr 14 03:00:56 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:00:56 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:00:56 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:00:56 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:00:56 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOME5HYCeirkN8OulnPuNQsWxiJbJ8PIhfdVqfi8LvyWXNORUNtqaIZg9cIY0OXo8yXtIgfFHz45Xn8IqxLoiOvCvSSl6vt-zyZMq9vAaJG2QKGTWWuMSxAkMB7N3iSxZl5K8fi1K8dVdFjJG0PzVdTA-wqXDbxYn2EQbT9Pk76kfw-o Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Project-Id: 46cec85cd4364c8eaad6870b92249a56 Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Project-Name: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46cec85cd4364c8eaad6870b92249a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46cec85cd4364c8eaad6870b92249a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46cec85cd4364c8eaad6870b92249a56"}]}] Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Tenant: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Tenant-Id: 46cec85cd4364c8eaad6870b92249a56 Apr 14 03:00:56 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:56 user devstack@n-api.service[61663]: X-User: tempest-DeleteServersTestJSON-360109579-project-member Apr 14 03:00:56 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:00:56 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:00:56 user devstack@n-api.service[61663]: X-User-Id: 70eb1e59ba1342688a8ce4e6ff440f58 Apr 14 03:00:56 user devstack@n-api.service[61663]: X-User-Name: tempest-DeleteServersTestJSON-360109579-project-member Apr 14 03:00:56 user devstack@n-api.service[61663]: method: > Apr 14 03:00:56 user devstack@n-api.service[61663]: exception: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:56 user devstack@n-api.service[61663]: action_args: {'server_id': '82a9ec77-951b-4394-b555-00a49710acb5'} Apr 14 03:00:56 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:56 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:00:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Returning 404 to user: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:00:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-47a83cb3-fb9d-47c2-a592-3515a98a39bb tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040313 Apr 14 03:00:56 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 72/212] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:00:56 2023] GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=44,nova_cell1:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] HTTP exception thrown: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Request method failure captured: Apr 14 03:00:59 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5 HTTP/1.1 Apr 14 03:00:59 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:00:59 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:00:59 user devstack@n-api.service[61664]: Connection: close Apr 14 03:00:59 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:00:59 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:00:59 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:00:59 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:00:59 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOME5HYCeirkN8OulnPuNQsWxiJbJ8PIhfdVqfi8LvyWXNORUNtqaIZg9cIY0OXo8yXtIgfFHz45Xn8IqxLoiOvCvSSl6vt-zyZMq9vAaJG2QKGTWWuMSxAkMB7N3iSxZl5K8fi1K8dVdFjJG0PzVdTA-wqXDbxYn2EQbT9Pk76kfw-o Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Project-Id: 46cec85cd4364c8eaad6870b92249a56 Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Project-Name: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46cec85cd4364c8eaad6870b92249a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46cec85cd4364c8eaad6870b92249a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46cec85cd4364c8eaad6870b92249a56"}]}] Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Tenant: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Tenant-Id: 46cec85cd4364c8eaad6870b92249a56 Apr 14 03:00:59 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:59 user devstack@n-api.service[61664]: X-User: tempest-DeleteServersTestJSON-360109579-project-member Apr 14 03:00:59 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:00:59 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:00:59 user devstack@n-api.service[61664]: X-User-Id: 70eb1e59ba1342688a8ce4e6ff440f58 Apr 14 03:00:59 user devstack@n-api.service[61664]: X-User-Name: tempest-DeleteServersTestJSON-360109579-project-member Apr 14 03:00:59 user devstack@n-api.service[61664]: method: > Apr 14 03:00:59 user devstack@n-api.service[61664]: exception: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:59 user devstack@n-api.service[61664]: action_args: {'id': '82a9ec77-951b-4394-b555-00a49710acb5'} Apr 14 03:00:59 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:59 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:00:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Returning 404 to user: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:00:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-fd5fb468-b755-4bf2-9d55-0052fb39db1d tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5" status: 404 len: 111 microversion: 2.1 time: 0.043067 Apr 14 03:00:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 71/213] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:00:59 2023] DELETE /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:00:59 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:00:59 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] [instance: 82a9ec77-951b-4394-b555-00a49710acb5] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:00:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:00:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:00:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:00:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] HTTP exception thrown: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:59 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Request method failure captured: Apr 14 03:00:59 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5 HTTP/1.1 Apr 14 03:00:59 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:00:59 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:00:59 user devstack@n-api.service[61662]: Connection: close Apr 14 03:00:59 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:00:59 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:00:59 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:00:59 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:00:59 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOME5HYCeirkN8OulnPuNQsWxiJbJ8PIhfdVqfi8LvyWXNORUNtqaIZg9cIY0OXo8yXtIgfFHz45Xn8IqxLoiOvCvSSl6vt-zyZMq9vAaJG2QKGTWWuMSxAkMB7N3iSxZl5K8fi1K8dVdFjJG0PzVdTA-wqXDbxYn2EQbT9Pk76kfw-o Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Project-Id: 46cec85cd4364c8eaad6870b92249a56 Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Project-Name: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46cec85cd4364c8eaad6870b92249a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46cec85cd4364c8eaad6870b92249a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46cec85cd4364c8eaad6870b92249a56"}]}] Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Tenant: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Tenant-Id: 46cec85cd4364c8eaad6870b92249a56 Apr 14 03:00:59 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-DeleteServersTestJSON-360109579 Apr 14 03:00:59 user devstack@n-api.service[61662]: X-User: tempest-DeleteServersTestJSON-360109579-project-member Apr 14 03:00:59 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:00:59 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:00:59 user devstack@n-api.service[61662]: X-User-Id: 70eb1e59ba1342688a8ce4e6ff440f58 Apr 14 03:00:59 user devstack@n-api.service[61662]: X-User-Name: tempest-DeleteServersTestJSON-360109579-project-member Apr 14 03:00:59 user devstack@n-api.service[61662]: method: > Apr 14 03:00:59 user devstack@n-api.service[61662]: exception: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:59 user devstack@n-api.service[61662]: action_args: {'id': '82a9ec77-951b-4394-b555-00a49710acb5'} Apr 14 03:00:59 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. Apr 14 03:00:59 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:00:59 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] Returning 404 to user: Instance 82a9ec77-951b-4394-b555-00a49710acb5 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:00:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-aeedcfdd-0497-4e83-9c41-58ee18117cb6 tempest-DeleteServersTestJSON-360109579 tempest-DeleteServersTestJSON-360109579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5" status: 404 len: 111 microversion: 2.1 time: 0.033673 Apr 14 03:00:59 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 71/214] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:00:59 2023] GET /compute/v2.1/servers/82a9ec77-951b-4394-b555-00a49710acb5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:01:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-489d52ad-c667-4815-a8a9-7b9061a44b97 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:09 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-489d52ad-c667-4815-a8a9-7b9061a44b97 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:09 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:09 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-489d52ad-c667-4815-a8a9-7b9061a44b97 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-489d52ad-c667-4815-a8a9-7b9061a44b97 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-489d52ad-c667-4815-a8a9-7b9061a44b97 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-489d52ad-c667-4815-a8a9-7b9061a44b97 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-489d52ad-c667-4815-a8a9-7b9061a44b97 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-489d52ad-c667-4815-a8a9-7b9061a44b97 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-489d52ad-c667-4815-a8a9-7b9061a44b97 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053361 Apr 14 03:01:09 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 73/215] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:01:09 2023] GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:01:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-437824819", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "2b0bbe21-b516-4656-8326-a02e9d0e0d38"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:09 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] validate_networks() for [('2b0bbe21-b516-4656-8326-a02e9d0e0d38', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Getting quotas for project 94a1eb61159b43228db0d529a5be816d. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Getting quotas for user f0d4916eb93c4b3ebbbd2af4b0cdacc1 and project 94a1eb61159b43228db0d529a5be816d. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:01:10 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 287a236d-d191-465f-bb65-636732ce5689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:01:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-94987643-382c-41c4-8a92-acc3156dd69f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.524978 Apr 14 03:01:10 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 72/216] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:01:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:01:10 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d4474c30-6579-46e1-b7ce-028098efb2b6 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:10 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d4474c30-6579-46e1-b7ce-028098efb2b6 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 287a236d-d191-465f-bb65-636732ce5689] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:10 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:10 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:10 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-d4474c30-6579-46e1-b7ce-028098efb2b6 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d4916eb93c4b3ebbbd2af4b0cdacc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1eb61159b43228db0d529a5be816d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d4474c30-6579-46e1-b7ce-028098efb2b6 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689" status: 200 len: 1211 microversion: 2.1 time: 0.091018 Apr 14 03:01:10 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 72/217] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:10 2023] GET /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-631add27-4af4-4df4-bacc-ee96f2904807 req-7c063446-8569-469d-98b8-e0187f4fab06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287a236d-d191-465f-bb65-636732ce5689", "tag": "7a4cd76a-7605-4209-9dd2-ec4bced26f20"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-631add27-4af4-4df4-bacc-ee96f2904807 req-7c063446-8569-469d-98b8-e0187f4fab06 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-631add27-4af4-4df4-bacc-ee96f2904807 req-7c063446-8569-469d-98b8-e0187f4fab06 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-631add27-4af4-4df4-bacc-ee96f2904807 req-7c063446-8569-469d-98b8-e0187f4fab06 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-631add27-4af4-4df4-bacc-ee96f2904807 req-7c063446-8569-469d-98b8-e0187f4fab06 service nova] Creating event network-changed:7a4cd76a-7605-4209-9dd2-ec4bced26f20 for instance 287a236d-d191-465f-bb65-636732ce5689 on user Apr 14 03:01:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-631add27-4af4-4df4-bacc-ee96f2904807 req-7c063446-8569-469d-98b8-e0187f4fab06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035619 Apr 14 03:01:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 74/218] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-dd2cef10-2534-42ed-a993-4210004564f4 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:14 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-dd2cef10-2534-42ed-a993-4210004564f4 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd2cef10-2534-42ed-a993-4210004564f4 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd2cef10-2534-42ed-a993-4210004564f4 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd2cef10-2534-42ed-a993-4210004564f4 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd2cef10-2534-42ed-a993-4210004564f4 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd2cef10-2534-42ed-a993-4210004564f4 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd2cef10-2534-42ed-a993-4210004564f4 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:14 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-dd2cef10-2534-42ed-a993-4210004564f4 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337e2d8118324215b5a0baa36a5895b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6371b4c05df843da9b134e12994c1d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-dd2cef10-2534-42ed-a993-4210004564f4 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28" status: 200 len: 1537 microversion: 2.1 time: 0.232752 Apr 14 03:01:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 73/219] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:14 2023] GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28 => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:15 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-5c25b03d-649d-420e-9f1a-b70d9ecd6e3b req-57f59666-d460-4bfd-aefe-802c91f6e657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287a236d-d191-465f-bb65-636732ce5689", "name": "network-vif-plugged", "status": "completed", "tag": "7a4cd76a-7605-4209-9dd2-ec4bced26f20"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5c25b03d-649d-420e-9f1a-b70d9ecd6e3b req-57f59666-d460-4bfd-aefe-802c91f6e657 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5c25b03d-649d-420e-9f1a-b70d9ecd6e3b req-57f59666-d460-4bfd-aefe-802c91f6e657 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5c25b03d-649d-420e-9f1a-b70d9ecd6e3b req-57f59666-d460-4bfd-aefe-802c91f6e657 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-5c25b03d-649d-420e-9f1a-b70d9ecd6e3b req-57f59666-d460-4bfd-aefe-802c91f6e657 service nova] Creating event network-vif-plugged:7a4cd76a-7605-4209-9dd2-ec4bced26f20 for instance 287a236d-d191-465f-bb65-636732ce5689 on user Apr 14 03:01:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-5c25b03d-649d-420e-9f1a-b70d9ecd6e3b req-57f59666-d460-4bfd-aefe-802c91f6e657 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029470 Apr 14 03:01:15 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 73/220] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:17 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-46f67978-e26d-4406-a397-d132617d56a1 req-f0a4c4bb-6453-45b5-83d9-6085b279bea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287a236d-d191-465f-bb65-636732ce5689", "name": "network-vif-plugged", "status": "completed", "tag": "7a4cd76a-7605-4209-9dd2-ec4bced26f20"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-46f67978-e26d-4406-a397-d132617d56a1 req-f0a4c4bb-6453-45b5-83d9-6085b279bea7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-46f67978-e26d-4406-a397-d132617d56a1 req-f0a4c4bb-6453-45b5-83d9-6085b279bea7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-46f67978-e26d-4406-a397-d132617d56a1 req-f0a4c4bb-6453-45b5-83d9-6085b279bea7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-46f67978-e26d-4406-a397-d132617d56a1 req-f0a4c4bb-6453-45b5-83d9-6085b279bea7 service nova] Creating event network-vif-plugged:7a4cd76a-7605-4209-9dd2-ec4bced26f20 for instance 287a236d-d191-465f-bb65-636732ce5689 on user Apr 14 03:01:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-46f67978-e26d-4406-a397-d132617d56a1 req-f0a4c4bb-6453-45b5-83d9-6085b279bea7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042592 Apr 14 03:01:17 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 75/221] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-cf2f12d6-2e84-45d6-a50b-772ae60d6461 req-294eb708-4164-4148-ba38-248626f8c9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca84990-b165-4d0b-a917-307cd8f96f28", "tag": "920aad6f-1d46-48d5-81eb-95ffbc851da0"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cf2f12d6-2e84-45d6-a50b-772ae60d6461 req-294eb708-4164-4148-ba38-248626f8c9e4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cf2f12d6-2e84-45d6-a50b-772ae60d6461 req-294eb708-4164-4148-ba38-248626f8c9e4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cf2f12d6-2e84-45d6-a50b-772ae60d6461 req-294eb708-4164-4148-ba38-248626f8c9e4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-cf2f12d6-2e84-45d6-a50b-772ae60d6461 req-294eb708-4164-4148-ba38-248626f8c9e4 service nova] Creating event network-changed:920aad6f-1d46-48d5-81eb-95ffbc851da0 for instance 2ca84990-b165-4d0b-a917-307cd8f96f28 on user Apr 14 03:01:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-cf2f12d6-2e84-45d6-a50b-772ae60d6461 req-294eb708-4164-4148-ba38-248626f8c9e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036830 Apr 14 03:01:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 74/222] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:17 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-50a8fbda-d9b1-4e0e-b933-627604850134 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edd92bd4-26a2-4652-bdc6-77805711142a"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:17 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-50a8fbda-d9b1-4e0e-b933-627604850134 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-50a8fbda-d9b1-4e0e-b933-627604850134 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-50a8fbda-d9b1-4e0e-b933-627604850134 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-50a8fbda-d9b1-4e0e-b933-627604850134 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-50a8fbda-d9b1-4e0e-b933-627604850134 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-50a8fbda-d9b1-4e0e-b933-627604850134 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-50a8fbda-d9b1-4e0e-b933-627604850134 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:18 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-50a8fbda-d9b1-4e0e-b933-627604850134 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.598069 Apr 14 03:01:18 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 74/223] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:01:17 2023] POST /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments => generated 194 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:01:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] HTTP exception thrown: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Request method failure captured: Apr 14 03:01:19 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a HTTP/1.1 Apr 14 03:01:19 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:01:19 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:01:19 user devstack@n-api.service[61663]: Connection: close Apr 14 03:01:19 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:01:19 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:01:19 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:01:19 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:01:19 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOME1zDxVfF-z6V2PnjXJJOtIQAI3V4AYU10egJ_qbo_dzOH9md58SLLGtsOr2tgGI30XTlCwHnMsZgR3nUDutIkedjgDSIfJVFVxmGr9J0JwRa81NVS9-14CtuzMNaOiuE2rPWLPluI07Qk6_5DSUEn1087-uGXH5rf8SnFwCvr2rN0 Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Project-Id: bcbeb4e2fdc1420c98c264aac62340a7 Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1798094222 Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bcbeb4e2fdc1420c98c264aac62340a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bcbeb4e2fdc1420c98c264aac62340a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bcbeb4e2fdc1420c98c264aac62340a7"}]}] Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1798094222 Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Tenant-Id: bcbeb4e2fdc1420c98c264aac62340a7 Apr 14 03:01:19 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1798094222 Apr 14 03:01:19 user devstack@n-api.service[61663]: X-User: tempest-AttachSCSIVolumeTestJSON-1798094222-project-member Apr 14 03:01:19 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:01:19 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:01:19 user devstack@n-api.service[61663]: X-User-Id: 9eabf8254cde4d86a1862934ec9b5240 Apr 14 03:01:19 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1798094222-project-member Apr 14 03:01:19 user devstack@n-api.service[61663]: method: > Apr 14 03:01:19 user devstack@n-api.service[61663]: exception: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:19 user devstack@n-api.service[61663]: action_args: {'id': 'e712dfa7-67a4-4459-9446-94fd8785b09a'} Apr 14 03:01:19 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:19 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:01:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Returning 404 to user: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:01:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3c59cf53-aca5-412d-a4d8-e33f2ddede7c tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a" status: 404 len: 111 microversion: 2.1 time: 0.040910 Apr 14 03:01:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 76/224] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:19 2023] GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:01:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-51da79ce-1f3d-4332-994c-1ebd47e3b719 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '.version_select at 0x7ff11ba06710>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-51da79ce-1f3d-4332-994c-1ebd47e3b719 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011448847" status: 202 len: 0 microversion: 2.1 time: 0.032738 Apr 14 03:01:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 75/225] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 03:01:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011448847 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] HTTP exception thrown: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Request method failure captured: Apr 14 03:01:24 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a HTTP/1.1 Apr 14 03:01:24 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:01:24 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:01:24 user devstack@n-api.service[61662]: Connection: close Apr 14 03:01:24 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:01:24 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:01:24 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:01:24 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:01:24 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOME1zDxVfF-z6V2PnjXJJOtIQAI3V4AYU10egJ_qbo_dzOH9md58SLLGtsOr2tgGI30XTlCwHnMsZgR3nUDutIkedjgDSIfJVFVxmGr9J0JwRa81NVS9-14CtuzMNaOiuE2rPWLPluI07Qk6_5DSUEn1087-uGXH5rf8SnFwCvr2rN0 Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Project-Id: bcbeb4e2fdc1420c98c264aac62340a7 Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1798094222 Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bcbeb4e2fdc1420c98c264aac62340a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bcbeb4e2fdc1420c98c264aac62340a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bcbeb4e2fdc1420c98c264aac62340a7"}]}] Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1798094222 Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Tenant-Id: bcbeb4e2fdc1420c98c264aac62340a7 Apr 14 03:01:24 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1798094222 Apr 14 03:01:24 user devstack@n-api.service[61662]: X-User: tempest-AttachSCSIVolumeTestJSON-1798094222-project-member Apr 14 03:01:24 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:01:24 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:01:24 user devstack@n-api.service[61662]: X-User-Id: 9eabf8254cde4d86a1862934ec9b5240 Apr 14 03:01:24 user devstack@n-api.service[61662]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1798094222-project-member Apr 14 03:01:24 user devstack@n-api.service[61662]: method: > Apr 14 03:01:24 user devstack@n-api.service[61662]: exception: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:24 user devstack@n-api.service[61662]: action_args: {'id': 'e712dfa7-67a4-4459-9446-94fd8785b09a'} Apr 14 03:01:24 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:01:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Returning 404 to user: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:01:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-18d0a1bf-b85c-4a30-8c49-3c3d93a38ab3 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a" status: 404 len: 111 microversion: 2.1 time: 0.032128 Apr 14 03:01:24 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 75/226] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:01:24 2023] DELETE /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:01:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:24 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] [instance: e712dfa7-67a4-4459-9446-94fd8785b09a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] HTTP exception thrown: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Request method failure captured: Apr 14 03:01:24 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a HTTP/1.1 Apr 14 03:01:24 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:01:24 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:01:24 user devstack@n-api.service[61663]: Connection: close Apr 14 03:01:24 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:01:24 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:01:24 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:01:24 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:01:24 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOME1zDxVfF-z6V2PnjXJJOtIQAI3V4AYU10egJ_qbo_dzOH9md58SLLGtsOr2tgGI30XTlCwHnMsZgR3nUDutIkedjgDSIfJVFVxmGr9J0JwRa81NVS9-14CtuzMNaOiuE2rPWLPluI07Qk6_5DSUEn1087-uGXH5rf8SnFwCvr2rN0 Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Project-Id: bcbeb4e2fdc1420c98c264aac62340a7 Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1798094222 Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bcbeb4e2fdc1420c98c264aac62340a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bcbeb4e2fdc1420c98c264aac62340a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bcbeb4e2fdc1420c98c264aac62340a7"}]}] Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1798094222 Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Tenant-Id: bcbeb4e2fdc1420c98c264aac62340a7 Apr 14 03:01:24 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1798094222 Apr 14 03:01:24 user devstack@n-api.service[61663]: X-User: tempest-AttachSCSIVolumeTestJSON-1798094222-project-member Apr 14 03:01:24 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:01:24 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:01:24 user devstack@n-api.service[61663]: X-User-Id: 9eabf8254cde4d86a1862934ec9b5240 Apr 14 03:01:24 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1798094222-project-member Apr 14 03:01:24 user devstack@n-api.service[61663]: method: > Apr 14 03:01:24 user devstack@n-api.service[61663]: exception: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:24 user devstack@n-api.service[61663]: action_args: {'id': 'e712dfa7-67a4-4459-9446-94fd8785b09a'} Apr 14 03:01:24 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. Apr 14 03:01:24 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:01:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] Returning 404 to user: Instance e712dfa7-67a4-4459-9446-94fd8785b09a could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:01:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-2e080af9-861b-45f4-8db7-0bb601006638 tempest-AttachSCSIVolumeTestJSON-1798094222 tempest-AttachSCSIVolumeTestJSON-1798094222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a" status: 404 len: 111 microversion: 2.1 time: 0.038327 Apr 14 03:01:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 77/227] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:24 2023] GET /compute/v2.1/servers/e712dfa7-67a4-4459-9446-94fd8785b09a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:01:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f2164c4d-1792-4743-8398-e814c2eb53db tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f2164c4d-1792-4743-8398-e814c2eb53db tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2164c4d-1792-4743-8398-e814c2eb53db tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2164c4d-1792-4743-8398-e814c2eb53db tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2164c4d-1792-4743-8398-e814c2eb53db tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2164c4d-1792-4743-8398-e814c2eb53db tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2164c4d-1792-4743-8398-e814c2eb53db tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2164c4d-1792-4743-8398-e814c2eb53db tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:26 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:26 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:27 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lazy-loading 'services' on Instance uuid 2ca84990-b165-4d0b-a917-307cd8f96f28 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-f2164c4d-1792-4743-8398-e814c2eb53db tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f2164c4d-1792-4743-8398-e814c2eb53db tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a" status: 200 len: 1379 microversion: 2.1 time: 0.219892 Apr 14 03:01:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 76/228] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:26 2023] GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a => generated 1379 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-2520d41d-45a1-488c-9514-b3fdaad76c9f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-2520d41d-45a1-488c-9514-b3fdaad76c9f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2520d41d-45a1-488c-9514-b3fdaad76c9f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2520d41d-45a1-488c-9514-b3fdaad76c9f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2520d41d-45a1-488c-9514-b3fdaad76c9f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2520d41d-45a1-488c-9514-b3fdaad76c9f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2520d41d-45a1-488c-9514-b3fdaad76c9f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2520d41d-45a1-488c-9514-b3fdaad76c9f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:27 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments/edd92bd4-26a2-4652-bdc6-77805711142a" status: 202 len: 0 microversion: 2.1 time: 0.266187 Apr 14 03:01:27 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 76/229] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:01:26 2023] DELETE /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments/edd92bd4-26a2-4652-bdc6-77805711142a => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8f906097-4c0c-458f-ab80-53b96b61eaed tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8f906097-4c0c-458f-ab80-53b96b61eaed tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f906097-4c0c-458f-ab80-53b96b61eaed tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f906097-4c0c-458f-ab80-53b96b61eaed tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f906097-4c0c-458f-ab80-53b96b61eaed tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f906097-4c0c-458f-ab80-53b96b61eaed tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f906097-4c0c-458f-ab80-53b96b61eaed tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f906097-4c0c-458f-ab80-53b96b61eaed tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8f906097-4c0c-458f-ab80-53b96b61eaed tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042252 Apr 14 03:01:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 77/230] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:01:27 2023] GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-2520d41d-45a1-488c-9514-b3fdaad76c9f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-2520d41d-45a1-488c-9514-b3fdaad76c9f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a" status: 200 len: 1379 microversion: 2.1 time: 0.216200 Apr 14 03:01:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 78/231] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:27 2023] GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a => generated 1379 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:27 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f59106a4-de65-4fbb-b377-2adee8c2f4cb tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:27 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-f59106a4-de65-4fbb-b377-2adee8c2f4cb tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f59106a4-de65-4fbb-b377-2adee8c2f4cb tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f59106a4-de65-4fbb-b377-2adee8c2f4cb tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f59106a4-de65-4fbb-b377-2adee8c2f4cb tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f59106a4-de65-4fbb-b377-2adee8c2f4cb tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f59106a4-de65-4fbb-b377-2adee8c2f4cb tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f59106a4-de65-4fbb-b377-2adee8c2f4cb tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:27 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-f59106a4-de65-4fbb-b377-2adee8c2f4cb tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:01:27 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f59106a4-de65-4fbb-b377-2adee8c2f4cb tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a" status: 204 len: 0 microversion: 2.1 time: 0.138040 Apr 14 03:01:27 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 77/232] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:01:27 2023] DELETE /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6ea4744d-6616-4041-9b99-b25b4912c5d1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6ea4744d-6616-4041-9b99-b25b4912c5d1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ea4744d-6616-4041-9b99-b25b4912c5d1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ea4744d-6616-4041-9b99-b25b4912c5d1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ea4744d-6616-4041-9b99-b25b4912c5d1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ea4744d-6616-4041-9b99-b25b4912c5d1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ea4744d-6616-4041-9b99-b25b4912c5d1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ea4744d-6616-4041-9b99-b25b4912c5d1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-47c24f6b-439c-4a22-bfc7-5ce6462626d6 req-7e500806-2b5d-49d2-998d-30fc39f72399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc99f782-81c1-4243-8853-5554e5663d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "c75de928-a52a-4a2a-b413-15a2be115846"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-47c24f6b-439c-4a22-bfc7-5ce6462626d6 req-7e500806-2b5d-49d2-998d-30fc39f72399 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-47c24f6b-439c-4a22-bfc7-5ce6462626d6 req-7e500806-2b5d-49d2-998d-30fc39f72399 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-47c24f6b-439c-4a22-bfc7-5ce6462626d6 req-7e500806-2b5d-49d2-998d-30fc39f72399 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-47c24f6b-439c-4a22-bfc7-5ce6462626d6 req-7e500806-2b5d-49d2-998d-30fc39f72399 service nova] Creating event network-vif-unplugged:c75de928-a52a-4a2a-b413-15a2be115846 for instance bc99f782-81c1-4243-8853-5554e5663d0a on user Apr 14 03:01:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-47c24f6b-439c-4a22-bfc7-5ce6462626d6 req-7e500806-2b5d-49d2-998d-30fc39f72399 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053041 Apr 14 03:01:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 79/233] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:28 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-6ea4744d-6616-4041-9b99-b25b4912c5d1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:28 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6ea4744d-6616-4041-9b99-b25b4912c5d1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a" status: 200 len: 1385 microversion: 2.1 time: 0.535902 Apr 14 03:01:28 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 78/234] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:27 2023] GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a => generated 1385 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-2a19afd9-722d-4fc4-b7b3-52351ef66d76 req-2c45d025-6f08-465e-ae20-c41bc4f8069c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc99f782-81c1-4243-8853-5554e5663d0a", "name": "network-vif-plugged", "status": "completed", "tag": "c75de928-a52a-4a2a-b413-15a2be115846"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-2a19afd9-722d-4fc4-b7b3-52351ef66d76 req-2c45d025-6f08-465e-ae20-c41bc4f8069c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-2a19afd9-722d-4fc4-b7b3-52351ef66d76 req-2c45d025-6f08-465e-ae20-c41bc4f8069c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-2a19afd9-722d-4fc4-b7b3-52351ef66d76 req-2c45d025-6f08-465e-ae20-c41bc4f8069c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:30 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-2a19afd9-722d-4fc4-b7b3-52351ef66d76 req-2c45d025-6f08-465e-ae20-c41bc4f8069c service nova] Creating event network-vif-plugged:c75de928-a52a-4a2a-b413-15a2be115846 for instance bc99f782-81c1-4243-8853-5554e5663d0a on user Apr 14 03:01:30 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-2a19afd9-722d-4fc4-b7b3-52351ef66d76 req-2c45d025-6f08-465e-ae20-c41bc4f8069c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032763 Apr 14 03:01:30 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 78/235] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ec99f6d5-92b2-439d-967a-39607a11686a tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:31 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ec99f6d5-92b2-439d-967a-39607a11686a tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 8a826438-d96e-4e70-b50e-aca4be008394] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ec99f6d5-92b2-439d-967a-39607a11686a tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ec99f6d5-92b2-439d-967a-39607a11686a tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ec99f6d5-92b2-439d-967a-39607a11686a tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ec99f6d5-92b2-439d-967a-39607a11686a tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ec99f6d5-92b2-439d-967a-39607a11686a tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ec99f6d5-92b2-439d-967a-39607a11686a tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:31 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ec99f6d5-92b2-439d-967a-39607a11686a tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 8a826438-d96e-4e70-b50e-aca4be008394] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:01:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ec99f6d5-92b2-439d-967a-39607a11686a tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394" status: 204 len: 0 microversion: 2.1 time: 0.138602 Apr 14 03:01:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 80/236] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:01:31 2023] DELETE /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:01:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7a7f2ebc-4430-4ced-a1c3-6017b4fd0455 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:31 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7a7f2ebc-4430-4ced-a1c3-6017b4fd0455 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 8a826438-d96e-4e70-b50e-aca4be008394] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7a7f2ebc-4430-4ced-a1c3-6017b4fd0455 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7a7f2ebc-4430-4ced-a1c3-6017b4fd0455 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7a7f2ebc-4430-4ced-a1c3-6017b4fd0455 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7a7f2ebc-4430-4ced-a1c3-6017b4fd0455 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7a7f2ebc-4430-4ced-a1c3-6017b4fd0455 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7a7f2ebc-4430-4ced-a1c3-6017b4fd0455 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:31 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7a7f2ebc-4430-4ced-a1c3-6017b4fd0455 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbce21e767a4a61b9213e38523d247e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021342634dd4f16bf2720533070154c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7a7f2ebc-4430-4ced-a1c3-6017b4fd0455 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394" status: 200 len: 1499 microversion: 2.1 time: 0.307104 Apr 14 03:01:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 79/237] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:31 2023] GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394 => generated 1499 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:32 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-a2bb4147-bbf7-4557-8bf1-67279e40ff4f req-85e085e1-66cb-409e-981c-c396a3178cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc99f782-81c1-4243-8853-5554e5663d0a", "name": "network-vif-deleted", "tag": "c75de928-a52a-4a2a-b413-15a2be115846"}, {"server_uuid": "8a826438-d96e-4e70-b50e-aca4be008394", "name": "network-vif-unplugged", "status": "completed", "tag": "8151f818-904f-472f-b66c-ee41b2c2975e"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a2bb4147-bbf7-4557-8bf1-67279e40ff4f req-85e085e1-66cb-409e-981c-c396a3178cd6 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a2bb4147-bbf7-4557-8bf1-67279e40ff4f req-85e085e1-66cb-409e-981c-c396a3178cd6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a2bb4147-bbf7-4557-8bf1-67279e40ff4f req-85e085e1-66cb-409e-981c-c396a3178cd6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:32 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-a2bb4147-bbf7-4557-8bf1-67279e40ff4f req-85e085e1-66cb-409e-981c-c396a3178cd6 service nova] Creating event network-vif-deleted:c75de928-a52a-4a2a-b413-15a2be115846 for instance bc99f782-81c1-4243-8853-5554e5663d0a on user Apr 14 03:01:32 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-a2bb4147-bbf7-4557-8bf1-67279e40ff4f req-85e085e1-66cb-409e-981c-c396a3178cd6 service nova] Creating event network-vif-unplugged:8151f818-904f-472f-b66c-ee41b2c2975e for instance 8a826438-d96e-4e70-b50e-aca4be008394 on user Apr 14 03:01:32 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-a2bb4147-bbf7-4557-8bf1-67279e40ff4f req-85e085e1-66cb-409e-981c-c396a3178cd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035416 Apr 14 03:01:32 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 79/238] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:32 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-f8f10b28-1483-461b-88a7-5ded9afecd56 req-bbcb7108-1017-409e-94a8-763b77fd871f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a826438-d96e-4e70-b50e-aca4be008394", "name": "network-vif-plugged", "status": "completed", "tag": "8151f818-904f-472f-b66c-ee41b2c2975e"}, {"server_uuid": "8a826438-d96e-4e70-b50e-aca4be008394", "name": "network-vif-deleted", "tag": "8151f818-904f-472f-b66c-ee41b2c2975e"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f8f10b28-1483-461b-88a7-5ded9afecd56 req-bbcb7108-1017-409e-94a8-763b77fd871f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f8f10b28-1483-461b-88a7-5ded9afecd56 req-bbcb7108-1017-409e-94a8-763b77fd871f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f8f10b28-1483-461b-88a7-5ded9afecd56 req-bbcb7108-1017-409e-94a8-763b77fd871f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f8f10b28-1483-461b-88a7-5ded9afecd56 req-bbcb7108-1017-409e-94a8-763b77fd871f service nova] Creating event network-vif-plugged:8151f818-904f-472f-b66c-ee41b2c2975e for instance 8a826438-d96e-4e70-b50e-aca4be008394 on user Apr 14 03:01:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f8f10b28-1483-461b-88a7-5ded9afecd56 req-bbcb7108-1017-409e-94a8-763b77fd871f service nova] Creating event network-vif-deleted:8151f818-904f-472f-b66c-ee41b2c2975e for instance 8a826438-d96e-4e70-b50e-aca4be008394 on user Apr 14 03:01:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-f8f10b28-1483-461b-88a7-5ded9afecd56 req-bbcb7108-1017-409e-94a8-763b77fd871f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072206 Apr 14 03:01:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 81/239] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e059bd2c-0f66-48a9-a902-b149ecf8723c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Action: 'create', calling method: .version_select at 0x7ff11a492680>, body: {"keypair": {"name": "tempest-keypair-1725553182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2LgMvQScP+3OkEhMtxQ8yPEKAnpsqLhU2Ng/RVA17usmzZNC2W9NST4JFW6H9lJuSVw3sE9aw2aZ0d/xexnkTBnPv0G1cmq0AenhUnYQ0O8vu1SCb2h6BoZ3JbQLKp9w=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:36 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-e059bd2c-0f66-48a9-a902-b149ecf8723c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Getting quotas for project de2d10e0d7e7477484e4204841a3980c. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:01:36 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-e059bd2c-0f66-48a9-a902-b149ecf8723c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Getting quotas for user c3c342144e51496190e32329225ddd2b and project de2d10e0d7e7477484e4204841a3980c. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:01:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e059bd2c-0f66-48a9-a902-b149ecf8723c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.042003 Apr 14 03:01:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 80/240] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 03:01:36 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 43 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 03:01:38 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-555989941", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "5a4438ff-dedf-4ee8-8ddb-487e4e13ed2f"}, {"port": "5b8574e2-f175-4432-a1cb-f17916ddc806", "tag": "port-1"}, {"port": "3e1675a7-2e92-4b45-a657-f7b811975097", "tag": "port-2"}, {"uuid": "5f76fac8-1285-44a2-b867-75852cec358c", "tag": "net-1"}, {"uuid": "5f76fac8-1285-44a2-b867-75852cec358c"}, {"uuid": "f8c5c19d-84ab-402e-ab63-9c3249afe5e5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f8c5c19d-84ab-402e-ab63-9c3249afe5e5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ba0a016e-f7ab-4aac-8fb3-ecf199678570", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "453b7855-8efd-41bd-806c-18ae2c03ac49", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c11ac81e-755b-4855-85b5-259c815fef2c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1151626857"}], "key_name": "tempest-keypair-1725553182", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:38 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] validate_networks() for [('5a4438ff-dedf-4ee8-8ddb-487e4e13ed2f', None, None, None, None, None), (None, None, '5b8574e2-f175-4432-a1cb-f17916ddc806', None, None, None), (None, None, '3e1675a7-2e92-4b45-a657-f7b811975097', None, None, None), ('5f76fac8-1285-44a2-b867-75852cec358c', None, None, None, None, None), ('5f76fac8-1285-44a2-b867-75852cec358c', None, None, None, None, None), ('f8c5c19d-84ab-402e-ab63-9c3249afe5e5', '10.2.2.100', None, None, None, None), ('f8c5c19d-84ab-402e-ab63-9c3249afe5e5', '10.2.2.200', None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:01:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-87cf8691-be94-4ea5-95d0-48fad685ac99 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-87cf8691-be94-4ea5-95d0-48fad685ac99 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-87cf8691-be94-4ea5-95d0-48fad685ac99 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-87cf8691-be94-4ea5-95d0-48fad685ac99 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-87cf8691-be94-4ea5-95d0-48fad685ac99 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-87cf8691-be94-4ea5-95d0-48fad685ac99 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-87cf8691-be94-4ea5-95d0-48fad685ac99 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-87cf8691-be94-4ea5-95d0-48fad685ac99 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-87cf8691-be94-4ea5-95d0-48fad685ac99 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:39 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-87cf8691-be94-4ea5-95d0-48fad685ac99 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6" status: 200 len: 1503 microversion: 2.1 time: 0.366892 Apr 14 03:01:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 82/241] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:39 2023] GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 => generated 1503 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Getting quotas for project de2d10e0d7e7477484e4204841a3980c. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:01:41 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Getting quotas for user c3c342144e51496190e32329225ddd2b and project de2d10e0d7e7477484e4204841a3980c. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:01:42 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:01:42 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ba0a016e-f7ab-4aac-8fb3-ecf199678570',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='453b7855-8efd-41bd-806c-18ae2c03ac49',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c11ac81e-755b-4855-85b5-259c815fef2c',volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:01:42 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-33369a24-11d9-40ea-b360-1ce5344f0d6b tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.845184 Apr 14 03:01:42 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 80/242] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 03:01:38 2023] POST /compute/v2.1/servers => generated 404 bytes in 3847 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 03:01:42 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=36 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-71ddbc56-475b-4901-b853-0026f8439bcb tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-71ddbc56-475b-4901-b853-0026f8439bcb tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:42 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:42 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-71ddbc56-475b-4901-b853-0026f8439bcb tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:42 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-71ddbc56-475b-4901-b853-0026f8439bcb tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:42 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-71ddbc56-475b-4901-b853-0026f8439bcb tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-71ddbc56-475b-4901-b853-0026f8439bcb tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a" status: 200 len: 1279 microversion: 2.32 time: 0.124942 Apr 14 03:01:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 81/243] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:01:42 2023] GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a => generated 1279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:01:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8f9adbfd-b880-4032-9856-244d94b5ab2b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-8f9adbfd-b880-4032-9856-244d94b5ab2b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:45 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8f9adbfd-b880-4032-9856-244d94b5ab2b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8f9adbfd-b880-4032-9856-244d94b5ab2b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8f9adbfd-b880-4032-9856-244d94b5ab2b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8f9adbfd-b880-4032-9856-244d94b5ab2b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8f9adbfd-b880-4032-9856-244d94b5ab2b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8f9adbfd-b880-4032-9856-244d94b5ab2b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:45 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-8f9adbfd-b880-4032-9856-244d94b5ab2b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8f9adbfd-b880-4032-9856-244d94b5ab2b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1656 microversion: 2.1 time: 0.245075 Apr 14 03:01:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 83/244] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:44 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1656 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:45 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0c626e1-cd60-46d3-b894-a000a5cb3811"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:45 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:45 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285993 Apr 14 03:01:45 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 81/245] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:01:45 2023] POST /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-bcd0766c-29b0-4f2c-aad8-e43165f8fdfb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bcd0766c-29b0-4f2c-aad8-e43165f8fdfb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bcd0766c-29b0-4f2c-aad8-e43165f8fdfb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bcd0766c-29b0-4f2c-aad8-e43165f8fdfb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:48 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-bcd0766c-29b0-4f2c-aad8-e43165f8fdfb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Going to try to start instance {{(pid=61664) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 03:01:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-bcd0766c-29b0-4f2c-aad8-e43165f8fdfb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/action" status: 202 len: 0 microversion: 2.1 time: 0.109701 Apr 14 03:01:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 82/246] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:01:48 2023] POST /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:01:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-003de3e9-a6d1-4df0-8a1d-c27f1d246ea9 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:48 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-003de3e9-a6d1-4df0-8a1d-c27f1d246ea9 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-003de3e9-a6d1-4df0-8a1d-c27f1d246ea9 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-003de3e9-a6d1-4df0-8a1d-c27f1d246ea9 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-003de3e9-a6d1-4df0-8a1d-c27f1d246ea9 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-003de3e9-a6d1-4df0-8a1d-c27f1d246ea9 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-003de3e9-a6d1-4df0-8a1d-c27f1d246ea9 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-003de3e9-a6d1-4df0-8a1d-c27f1d246ea9 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:48 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-003de3e9-a6d1-4df0-8a1d-c27f1d246ea9 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-003de3e9-a6d1-4df0-8a1d-c27f1d246ea9 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1697 microversion: 2.1 time: 0.276163 Apr 14 03:01:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 84/247] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:48 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1697 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-f62ecae9-50a0-4783-838d-eb3789722c21 req-83fd9ae8-e191-42cc-8255-100ebb1e7039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "tag": "7e8d8948-ff3b-461a-921a-d90f46d9f84c"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f62ecae9-50a0-4783-838d-eb3789722c21 req-83fd9ae8-e191-42cc-8255-100ebb1e7039 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f62ecae9-50a0-4783-838d-eb3789722c21 req-83fd9ae8-e191-42cc-8255-100ebb1e7039 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f62ecae9-50a0-4783-838d-eb3789722c21 req-83fd9ae8-e191-42cc-8255-100ebb1e7039 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-f62ecae9-50a0-4783-838d-eb3789722c21 req-83fd9ae8-e191-42cc-8255-100ebb1e7039 service nova] Creating event network-changed:7e8d8948-ff3b-461a-921a-d90f46d9f84c for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:01:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-f62ecae9-50a0-4783-838d-eb3789722c21 req-83fd9ae8-e191-42cc-8255-100ebb1e7039 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029678 Apr 14 03:01:49 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 82/248] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-24ceee17-3070-4c41-a073-4a5be0d51235 req-03e694c8-acff-490c-8755-64abc42d811a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "tag": "3e1675a7-2e92-4b45-a657-f7b811975097"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-24ceee17-3070-4c41-a073-4a5be0d51235 req-03e694c8-acff-490c-8755-64abc42d811a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-24ceee17-3070-4c41-a073-4a5be0d51235 req-03e694c8-acff-490c-8755-64abc42d811a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-24ceee17-3070-4c41-a073-4a5be0d51235 req-03e694c8-acff-490c-8755-64abc42d811a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-24ceee17-3070-4c41-a073-4a5be0d51235 req-03e694c8-acff-490c-8755-64abc42d811a service nova] Creating event network-changed:3e1675a7-2e92-4b45-a657-f7b811975097 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:01:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-24ceee17-3070-4c41-a073-4a5be0d51235 req-03e694c8-acff-490c-8755-64abc42d811a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032298 Apr 14 03:01:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 83/249] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d0b35235-b9db-4c6d-961c-2107227f102b req-7b05347c-d944-4ab3-952e-cc2db524d7cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "tag": "5b8574e2-f175-4432-a1cb-f17916ddc806"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d0b35235-b9db-4c6d-961c-2107227f102b req-7b05347c-d944-4ab3-952e-cc2db524d7cc service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d0b35235-b9db-4c6d-961c-2107227f102b req-7b05347c-d944-4ab3-952e-cc2db524d7cc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d0b35235-b9db-4c6d-961c-2107227f102b req-7b05347c-d944-4ab3-952e-cc2db524d7cc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d0b35235-b9db-4c6d-961c-2107227f102b req-7b05347c-d944-4ab3-952e-cc2db524d7cc service nova] Creating event network-changed:5b8574e2-f175-4432-a1cb-f17916ddc806 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:01:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d0b35235-b9db-4c6d-961c-2107227f102b req-7b05347c-d944-4ab3-952e-cc2db524d7cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031989 Apr 14 03:01:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 85/250] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:53 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:53 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:53 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-7e4d545f-5791-46c4-aaa3-d0868f1a1b02 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Action: 'create', calling method: .version_select at 0x7ff11a5f49d0>, body: {"keypair": {"name": "tempest-keypair-603146841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnYqF9Yc0//Xc2kqydIgMZFcAkhLZn1nUjuDCDft78aomgzO7Y5n1Hl9qALLn2itHKhHsgBqDZqHr/4EY/d5MXpZoR4+r1CWeR2M7mZVFWbBOGHV8B0e9m5AsRBcS+9/g=="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:53 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-7e4d545f-5791-46c4-aaa3-d0868f1a1b02 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Getting quotas for project f987064bf0ed4a2fa8714064fe8b43c8. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:01:53 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-7e4d545f-5791-46c4-aaa3-d0868f1a1b02 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Getting quotas for user f089c5c093754f8082181a8fc1c002f4 and project f987064bf0ed4a2fa8714064fe8b43c8. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:01:53 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-7e4d545f-5791-46c4-aaa3-d0868f1a1b02 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055474 Apr 14 03:01:53 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 83/251] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:01:53 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:53 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-fb864f17-c31d-4b7f-8a2e-b4d5c7367a67 req-7ea53fe4-8ba8-488d-b84c-4a7648c2df4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "tag": "04ec9de5-1982-4641-8e4f-6eed7f00cf51"}, {"name": "network-changed", "server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "tag": "fa3f5b14-6337-4e66-b990-1ba1cb8ab667"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-fb864f17-c31d-4b7f-8a2e-b4d5c7367a67 req-7ea53fe4-8ba8-488d-b84c-4a7648c2df4f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-fb864f17-c31d-4b7f-8a2e-b4d5c7367a67 req-7ea53fe4-8ba8-488d-b84c-4a7648c2df4f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-fb864f17-c31d-4b7f-8a2e-b4d5c7367a67 req-7ea53fe4-8ba8-488d-b84c-4a7648c2df4f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-fb864f17-c31d-4b7f-8a2e-b4d5c7367a67 req-7ea53fe4-8ba8-488d-b84c-4a7648c2df4f service nova] Creating event network-changed:04ec9de5-1982-4641-8e4f-6eed7f00cf51 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:01:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-fb864f17-c31d-4b7f-8a2e-b4d5c7367a67 req-7ea53fe4-8ba8-488d-b84c-4a7648c2df4f service nova] Creating event network-changed:fa3f5b14-6337-4e66-b990-1ba1cb8ab667 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:01:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-fb864f17-c31d-4b7f-8a2e-b4d5c7367a67 req-7ea53fe4-8ba8-488d-b84c-4a7648c2df4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032959 Apr 14 03:01:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 84/252] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:53 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d4768408-cefe-4bb3-99a8-9460f71fe48e tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:54 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d4768408-cefe-4bb3-99a8-9460f71fe48e tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d4768408-cefe-4bb3-99a8-9460f71fe48e tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d4768408-cefe-4bb3-99a8-9460f71fe48e tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d4768408-cefe-4bb3-99a8-9460f71fe48e tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d4768408-cefe-4bb3-99a8-9460f71fe48e tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d4768408-cefe-4bb3-99a8-9460f71fe48e tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d4768408-cefe-4bb3-99a8-9460f71fe48e tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:54 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-bb921526-e84f-4b18-a128-3917d3ec30cc req-822f1a10-2948-41d1-a187-d6de7923ea8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-bb921526-e84f-4b18-a128-3917d3ec30cc req-822f1a10-2948-41d1-a187-d6de7923ea8f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-bb921526-e84f-4b18-a128-3917d3ec30cc req-822f1a10-2948-41d1-a187-d6de7923ea8f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-bb921526-e84f-4b18-a128-3917d3ec30cc req-822f1a10-2948-41d1-a187-d6de7923ea8f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:54 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-bb921526-e84f-4b18-a128-3917d3ec30cc req-822f1a10-2948-41d1-a187-d6de7923ea8f service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:01:54 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-bb921526-e84f-4b18-a128-3917d3ec30cc req-822f1a10-2948-41d1-a187-d6de7923ea8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079810 Apr 14 03:01:54 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 84/253] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-d4768408-cefe-4bb3-99a8-9460f71fe48e tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d4768408-cefe-4bb3-99a8-9460f71fe48e tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1702 microversion: 2.1 time: 0.349398 Apr 14 03:01:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 86/254] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:54 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1702 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1052167823", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for project 4075885e26cb4adaad24d3ae6217fe35. Resources: dict_keys(['metadata_items']) {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for user 7dea23743ba945c4a9d539b8e277c653 and project 4075885e26cb4adaad24d3ae6217fe35. Resources: dict_keys(['metadata_items']) {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:01:54 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b8231917-215f-42f7-b3f3-2057fb1c602b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/action" status: 202 len: 1158 microversion: 2.1 time: 0.417825 Apr 14 03:01:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 85/255] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 03:01:54 2023] POST /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/action => generated 1158 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 03:01:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-908bf103-2f95-41e4-8079-aa5833469931 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:55 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-908bf103-2f95-41e4-8079-aa5833469931 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908bf103-2f95-41e4-8079-aa5833469931 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908bf103-2f95-41e4-8079-aa5833469931 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908bf103-2f95-41e4-8079-aa5833469931 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908bf103-2f95-41e4-8079-aa5833469931 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908bf103-2f95-41e4-8079-aa5833469931 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908bf103-2f95-41e4-8079-aa5833469931 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1072264904", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "c5b60b86-e5de-4981-96d7-316ce84984f2"}], "security_groups": [{"name": "tempest-securitygroup--421282494"}], "key_name": "tempest-keypair-603146841", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-6b3e0b68-d3a4-48d1-b8be-ac57c39642f5 req-dd40d4b0-35a8-4836-a5b7-01661530e931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "tag": "e99be0b2-4a16-49d7-95ed-51790df3da10"}, {"name": "network-changed", "server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "tag": "65202a6a-2d5f-420b-a2bb-02ad01831633"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6b3e0b68-d3a4-48d1-b8be-ac57c39642f5 req-dd40d4b0-35a8-4836-a5b7-01661530e931 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6b3e0b68-d3a4-48d1-b8be-ac57c39642f5 req-dd40d4b0-35a8-4836-a5b7-01661530e931 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6b3e0b68-d3a4-48d1-b8be-ac57c39642f5 req-dd40d4b0-35a8-4836-a5b7-01661530e931 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6b3e0b68-d3a4-48d1-b8be-ac57c39642f5 req-dd40d4b0-35a8-4836-a5b7-01661530e931 service nova] Creating event network-changed:e99be0b2-4a16-49d7-95ed-51790df3da10 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:01:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6b3e0b68-d3a4-48d1-b8be-ac57c39642f5 req-dd40d4b0-35a8-4836-a5b7-01661530e931 service nova] Creating event network-changed:65202a6a-2d5f-420b-a2bb-02ad01831633 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:01:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-6b3e0b68-d3a4-48d1-b8be-ac57c39642f5 req-dd40d4b0-35a8-4836-a5b7-01661530e931 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051556 Apr 14 03:01:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 86/256] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:55 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:55 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] validate_networks() for [('c5b60b86-e5de-4981-96d7-316ce84984f2', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:01:55 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-908bf103-2f95-41e4-8079-aa5833469931 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-908bf103-2f95-41e4-8079-aa5833469931 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1730 microversion: 2.1 time: 0.460484 Apr 14 03:01:55 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 85/257] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:55 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1730 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a9841919-d8ec-4ae0-ac99-744f90e94878 req-b785a460-756c-4dae-a84e-f476be2fc13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-unplugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a9841919-d8ec-4ae0-ac99-744f90e94878 req-b785a460-756c-4dae-a84e-f476be2fc13d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a9841919-d8ec-4ae0-ac99-744f90e94878 req-b785a460-756c-4dae-a84e-f476be2fc13d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a9841919-d8ec-4ae0-ac99-744f90e94878 req-b785a460-756c-4dae-a84e-f476be2fc13d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a9841919-d8ec-4ae0-ac99-744f90e94878 req-b785a460-756c-4dae-a84e-f476be2fc13d service nova] Creating event network-vif-unplugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:01:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a9841919-d8ec-4ae0-ac99-744f90e94878 req-b785a460-756c-4dae-a84e-f476be2fc13d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045997 Apr 14 03:01:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 87/258] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Getting quotas for project f987064bf0ed4a2fa8714064fe8b43c8. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Getting quotas for user f089c5c093754f8082181a8fc1c002f4 and project f987064bf0ed4a2fa8714064fe8b43c8. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:01:56 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:01:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4faee412-c7f5-4724-a362-293239d21f4c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.961519 Apr 14 03:01:56 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 87/259] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:01:55 2023] POST /compute/v2.1/servers => generated 403 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:01:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b73cfc5a-7f8f-4b32-a94a-931d73a13628 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:01:56 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-b73cfc5a-7f8f-4b32-a94a-931d73a13628 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:01:56 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-b73cfc5a-7f8f-4b32-a94a-931d73a13628 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f089c5c093754f8082181a8fc1c002f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f987064bf0ed4a2fa8714064fe8b43c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:01:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b73cfc5a-7f8f-4b32-a94a-931d73a13628 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49" status: 200 len: 1225 microversion: 2.1 time: 0.217752 Apr 14 03:01:56 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 86/260] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:01:56 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 => generated 1225 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:01:56 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-6ff613b0-6371-4664-916f-97059b55316a req-ae27ec28-00df-43f6-9b34-6e0f192cb266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6ff613b0-6371-4664-916f-97059b55316a req-ae27ec28-00df-43f6-9b34-6e0f192cb266 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6ff613b0-6371-4664-916f-97059b55316a req-ae27ec28-00df-43f6-9b34-6e0f192cb266 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6ff613b0-6371-4664-916f-97059b55316a req-ae27ec28-00df-43f6-9b34-6e0f192cb266 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:56 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6ff613b0-6371-4664-916f-97059b55316a req-ae27ec28-00df-43f6-9b34-6e0f192cb266 service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:01:56 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-6ff613b0-6371-4664-916f-97059b55316a req-ae27ec28-00df-43f6-9b34-6e0f192cb266 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033491 Apr 14 03:01:56 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 88/261] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:01:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-5a4166be-c11d-4044-9bc4-190045c42af1 req-fa616c13-eaf5-4c19-bacc-a22f616ebd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}, {"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}, {"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}, {"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-unplugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}, {"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:01:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5a4166be-c11d-4044-9bc4-190045c42af1 req-fa616c13-eaf5-4c19-bacc-a22f616ebd6f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:01:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5a4166be-c11d-4044-9bc4-190045c42af1 req-fa616c13-eaf5-4c19-bacc-a22f616ebd6f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:01:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5a4166be-c11d-4044-9bc4-190045c42af1 req-fa616c13-eaf5-4c19-bacc-a22f616ebd6f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:01:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5a4166be-c11d-4044-9bc4-190045c42af1 req-fa616c13-eaf5-4c19-bacc-a22f616ebd6f service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:01:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5a4166be-c11d-4044-9bc4-190045c42af1 req-fa616c13-eaf5-4c19-bacc-a22f616ebd6f service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:01:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5a4166be-c11d-4044-9bc4-190045c42af1 req-fa616c13-eaf5-4c19-bacc-a22f616ebd6f service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:01:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5a4166be-c11d-4044-9bc4-190045c42af1 req-fa616c13-eaf5-4c19-bacc-a22f616ebd6f service nova] Creating event network-vif-unplugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:01:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5a4166be-c11d-4044-9bc4-190045c42af1 req-fa616c13-eaf5-4c19-bacc-a22f616ebd6f service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:01:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-5a4166be-c11d-4044-9bc4-190045c42af1 req-fa616c13-eaf5-4c19-bacc-a22f616ebd6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034592 Apr 14 03:01:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 88/262] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:01:57 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:02:00 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f6acc360-493a-4361-a398-0a38b0a3eaa2 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:00 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-f6acc360-493a-4361-a398-0a38b0a3eaa2 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 287a236d-d191-465f-bb65-636732ce5689] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6acc360-493a-4361-a398-0a38b0a3eaa2 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6acc360-493a-4361-a398-0a38b0a3eaa2 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6acc360-493a-4361-a398-0a38b0a3eaa2 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6acc360-493a-4361-a398-0a38b0a3eaa2 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6acc360-493a-4361-a398-0a38b0a3eaa2 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6acc360-493a-4361-a398-0a38b0a3eaa2 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:00 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-f6acc360-493a-4361-a398-0a38b0a3eaa2 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d4916eb93c4b3ebbbd2af4b0cdacc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1eb61159b43228db0d529a5be816d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:00 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f6acc360-493a-4361-a398-0a38b0a3eaa2 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689" status: 200 len: 1496 microversion: 2.1 time: 0.308002 Apr 14 03:02:00 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 87/263] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:00 2023] GET /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689 => generated 1496 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:02:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-11adf592-3253-48ac-8c64-5857895578c0 req-deea42d0-3fde-4e9f-b67e-af605bf4345f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49", "tag": "b975970e-4ce0-4b1c-b1b3-956befa892e0"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-11adf592-3253-48ac-8c64-5857895578c0 req-deea42d0-3fde-4e9f-b67e-af605bf4345f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-11adf592-3253-48ac-8c64-5857895578c0 req-deea42d0-3fde-4e9f-b67e-af605bf4345f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-11adf592-3253-48ac-8c64-5857895578c0 req-deea42d0-3fde-4e9f-b67e-af605bf4345f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-11adf592-3253-48ac-8c64-5857895578c0 req-deea42d0-3fde-4e9f-b67e-af605bf4345f service nova] Creating event network-changed:b975970e-4ce0-4b1c-b1b3-956befa892e0 for instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 on user Apr 14 03:02:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-11adf592-3253-48ac-8c64-5857895578c0 req-deea42d0-3fde-4e9f-b67e-af605bf4345f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041578 Apr 14 03:02:01 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 89/264] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-265eb707-f5db-4032-9b49-38938960ff16 req-f1a3274f-6653-4f01-8dbd-3020dd5cbadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49", "name": "network-vif-plugged", "status": "completed", "tag": "b975970e-4ce0-4b1c-b1b3-956befa892e0"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-265eb707-f5db-4032-9b49-38938960ff16 req-f1a3274f-6653-4f01-8dbd-3020dd5cbadf service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-265eb707-f5db-4032-9b49-38938960ff16 req-f1a3274f-6653-4f01-8dbd-3020dd5cbadf service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-265eb707-f5db-4032-9b49-38938960ff16 req-f1a3274f-6653-4f01-8dbd-3020dd5cbadf service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-265eb707-f5db-4032-9b49-38938960ff16 req-f1a3274f-6653-4f01-8dbd-3020dd5cbadf service nova] Creating event network-vif-plugged:b975970e-4ce0-4b1c-b1b3-956befa892e0 for instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 on user Apr 14 03:02:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-265eb707-f5db-4032-9b49-38938960ff16 req-f1a3274f-6653-4f01-8dbd-3020dd5cbadf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036643 Apr 14 03:02:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 89/265] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:05 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-d2ffc9b5-3a5a-4afa-a0ee-583400f8fb64 req-46db8be6-4e33-40a4-b2a0-7f8c0661b230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49", "name": "network-vif-plugged", "status": "completed", "tag": "b975970e-4ce0-4b1c-b1b3-956befa892e0"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:05 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d2ffc9b5-3a5a-4afa-a0ee-583400f8fb64 req-46db8be6-4e33-40a4-b2a0-7f8c0661b230 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:05 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d2ffc9b5-3a5a-4afa-a0ee-583400f8fb64 req-46db8be6-4e33-40a4-b2a0-7f8c0661b230 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:05 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d2ffc9b5-3a5a-4afa-a0ee-583400f8fb64 req-46db8be6-4e33-40a4-b2a0-7f8c0661b230 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:05 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-d2ffc9b5-3a5a-4afa-a0ee-583400f8fb64 req-46db8be6-4e33-40a4-b2a0-7f8c0661b230 service nova] Creating event network-vif-plugged:b975970e-4ce0-4b1c-b1b3-956befa892e0 for instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 on user Apr 14 03:02:05 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-d2ffc9b5-3a5a-4afa-a0ee-583400f8fb64 req-46db8be6-4e33-40a4-b2a0-7f8c0661b230 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033553 Apr 14 03:02:05 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 88/266] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e9c5d5b4-1442-4bac-b6ef-446e3127a2fe req-9d95d27b-0aa4-4383-8067-07e78970a7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "7e8d8948-ff3b-461a-921a-d90f46d9f84c"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e9c5d5b4-1442-4bac-b6ef-446e3127a2fe req-9d95d27b-0aa4-4383-8067-07e78970a7af service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e9c5d5b4-1442-4bac-b6ef-446e3127a2fe req-9d95d27b-0aa4-4383-8067-07e78970a7af service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e9c5d5b4-1442-4bac-b6ef-446e3127a2fe req-9d95d27b-0aa4-4383-8067-07e78970a7af service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e9c5d5b4-1442-4bac-b6ef-446e3127a2fe req-9d95d27b-0aa4-4383-8067-07e78970a7af service nova] Creating event network-vif-plugged:7e8d8948-ff3b-461a-921a-d90f46d9f84c for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e9c5d5b4-1442-4bac-b6ef-446e3127a2fe req-9d95d27b-0aa4-4383-8067-07e78970a7af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049541 Apr 14 03:02:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 90/267] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:07 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:07 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-4d825659-e57e-4639-80e9-7ea06490e518 req-e06dba0f-ee8c-4791-8491-f765871ae03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "5b8574e2-f175-4432-a1cb-f17916ddc806"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d825659-e57e-4639-80e9-7ea06490e518 req-e06dba0f-ee8c-4791-8491-f765871ae03c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d825659-e57e-4639-80e9-7ea06490e518 req-e06dba0f-ee8c-4791-8491-f765871ae03c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d825659-e57e-4639-80e9-7ea06490e518 req-e06dba0f-ee8c-4791-8491-f765871ae03c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-4d825659-e57e-4639-80e9-7ea06490e518 req-e06dba0f-ee8c-4791-8491-f765871ae03c service nova] Creating event network-vif-plugged:5b8574e2-f175-4432-a1cb-f17916ddc806 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-4d825659-e57e-4639-80e9-7ea06490e518 req-e06dba0f-ee8c-4791-8491-f765871ae03c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055146 Apr 14 03:02:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 90/268] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:10 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-af3eb04d-d40c-4f18-aa2a-efc82b73f9a5 req-72313aa8-f15b-4ca2-a529-8e18512b501d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "5b8574e2-f175-4432-a1cb-f17916ddc806"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "3e1675a7-2e92-4b45-a657-f7b811975097"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "3e1675a7-2e92-4b45-a657-f7b811975097"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:10 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-871870e8-c595-45a3-834e-acd124efbcf7 req-95c18028-cb0f-446f-add1-67e5f076dc64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "7e8d8948-ff3b-461a-921a-d90f46d9f84c"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "04ec9de5-1982-4641-8e4f-6eed7f00cf51"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:10 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-af3eb04d-d40c-4f18-aa2a-efc82b73f9a5 req-72313aa8-f15b-4ca2-a529-8e18512b501d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-af3eb04d-d40c-4f18-aa2a-efc82b73f9a5 req-72313aa8-f15b-4ca2-a529-8e18512b501d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-af3eb04d-d40c-4f18-aa2a-efc82b73f9a5 req-72313aa8-f15b-4ca2-a529-8e18512b501d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-871870e8-c595-45a3-834e-acd124efbcf7 req-95c18028-cb0f-446f-add1-67e5f076dc64 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-871870e8-c595-45a3-834e-acd124efbcf7 req-95c18028-cb0f-446f-add1-67e5f076dc64 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-871870e8-c595-45a3-834e-acd124efbcf7 req-95c18028-cb0f-446f-add1-67e5f076dc64 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-871870e8-c595-45a3-834e-acd124efbcf7 req-95c18028-cb0f-446f-add1-67e5f076dc64 service nova] Creating event network-vif-plugged:7e8d8948-ff3b-461a-921a-d90f46d9f84c for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-871870e8-c595-45a3-834e-acd124efbcf7 req-95c18028-cb0f-446f-add1-67e5f076dc64 service nova] Creating event network-vif-plugged:04ec9de5-1982-4641-8e4f-6eed7f00cf51 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-af3eb04d-d40c-4f18-aa2a-efc82b73f9a5 req-72313aa8-f15b-4ca2-a529-8e18512b501d service nova] Creating event network-vif-plugged:5b8574e2-f175-4432-a1cb-f17916ddc806 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-af3eb04d-d40c-4f18-aa2a-efc82b73f9a5 req-72313aa8-f15b-4ca2-a529-8e18512b501d service nova] Creating event network-vif-plugged:3e1675a7-2e92-4b45-a657-f7b811975097 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-af3eb04d-d40c-4f18-aa2a-efc82b73f9a5 req-72313aa8-f15b-4ca2-a529-8e18512b501d service nova] Creating event network-vif-plugged:3e1675a7-2e92-4b45-a657-f7b811975097 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-871870e8-c595-45a3-834e-acd124efbcf7 req-95c18028-cb0f-446f-add1-67e5f076dc64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060403 Apr 14 03:02:10 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 91/269] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-af3eb04d-d40c-4f18-aa2a-efc82b73f9a5 req-72313aa8-f15b-4ca2-a529-8e18512b501d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.065283 Apr 14 03:02:10 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 89/270] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:10 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:10 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-5ea19de2-c281-437b-b17f-3309b3f8eadb req-83858a0c-3c58-42d5-b7e7-566bb573a55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5ea19de2-c281-437b-b17f-3309b3f8eadb req-83858a0c-3c58-42d5-b7e7-566bb573a55d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5ea19de2-c281-437b-b17f-3309b3f8eadb req-83858a0c-3c58-42d5-b7e7-566bb573a55d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5ea19de2-c281-437b-b17f-3309b3f8eadb req-83858a0c-3c58-42d5-b7e7-566bb573a55d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:10 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=30 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5ea19de2-c281-437b-b17f-3309b3f8eadb req-83858a0c-3c58-42d5-b7e7-566bb573a55d service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:02:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-5ea19de2-c281-437b-b17f-3309b3f8eadb req-83858a0c-3c58-42d5-b7e7-566bb573a55d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045123 Apr 14 03:02:10 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 91/271] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a389d6b8-0a6a-457d-89ef-2fece4293277 req-6ebbfaf5-9153-44e8-bff9-a5aaa99f7d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "e99be0b2-4a16-49d7-95ed-51790df3da10"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "e99be0b2-4a16-49d7-95ed-51790df3da10"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "65202a6a-2d5f-420b-a2bb-02ad01831633"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a389d6b8-0a6a-457d-89ef-2fece4293277 req-6ebbfaf5-9153-44e8-bff9-a5aaa99f7d14 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a389d6b8-0a6a-457d-89ef-2fece4293277 req-6ebbfaf5-9153-44e8-bff9-a5aaa99f7d14 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a389d6b8-0a6a-457d-89ef-2fece4293277 req-6ebbfaf5-9153-44e8-bff9-a5aaa99f7d14 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:12 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-272c7135-df7b-458b-a6e8-f1d956fcee4e req-ad8b3632-3e86-472d-b407-b6fedc23686f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "04ec9de5-1982-4641-8e4f-6eed7f00cf51"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "fa3f5b14-6337-4e66-b990-1ba1cb8ab667"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "fa3f5b14-6337-4e66-b990-1ba1cb8ab667"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a389d6b8-0a6a-457d-89ef-2fece4293277 req-6ebbfaf5-9153-44e8-bff9-a5aaa99f7d14 service nova] Creating event network-vif-plugged:e99be0b2-4a16-49d7-95ed-51790df3da10 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a389d6b8-0a6a-457d-89ef-2fece4293277 req-6ebbfaf5-9153-44e8-bff9-a5aaa99f7d14 service nova] Creating event network-vif-plugged:e99be0b2-4a16-49d7-95ed-51790df3da10 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a389d6b8-0a6a-457d-89ef-2fece4293277 req-6ebbfaf5-9153-44e8-bff9-a5aaa99f7d14 service nova] Creating event network-vif-plugged:65202a6a-2d5f-420b-a2bb-02ad01831633 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:12 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-272c7135-df7b-458b-a6e8-f1d956fcee4e req-ad8b3632-3e86-472d-b407-b6fedc23686f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a389d6b8-0a6a-457d-89ef-2fece4293277 req-6ebbfaf5-9153-44e8-bff9-a5aaa99f7d14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035709 Apr 14 03:02:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-272c7135-df7b-458b-a6e8-f1d956fcee4e req-ad8b3632-3e86-472d-b407-b6fedc23686f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-272c7135-df7b-458b-a6e8-f1d956fcee4e req-ad8b3632-3e86-472d-b407-b6fedc23686f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 92/272] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:12 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:12 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-272c7135-df7b-458b-a6e8-f1d956fcee4e req-ad8b3632-3e86-472d-b407-b6fedc23686f service nova] Creating event network-vif-plugged:04ec9de5-1982-4641-8e4f-6eed7f00cf51 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-272c7135-df7b-458b-a6e8-f1d956fcee4e req-ad8b3632-3e86-472d-b407-b6fedc23686f service nova] Creating event network-vif-plugged:fa3f5b14-6337-4e66-b990-1ba1cb8ab667 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-272c7135-df7b-458b-a6e8-f1d956fcee4e req-ad8b3632-3e86-472d-b407-b6fedc23686f service nova] Creating event network-vif-plugged:fa3f5b14-6337-4e66-b990-1ba1cb8ab667 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-272c7135-df7b-458b-a6e8-f1d956fcee4e req-ad8b3632-3e86-472d-b407-b6fedc23686f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044795 Apr 14 03:02:12 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 90/273] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:12 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-1fed7410-04b1-416e-b416-e4daa8825cb4 req-55213fb0-bd89-45d2-8f87-0fb94ca3f3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1fed7410-04b1-416e-b416-e4daa8825cb4 req-55213fb0-bd89-45d2-8f87-0fb94ca3f3dc service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1fed7410-04b1-416e-b416-e4daa8825cb4 req-55213fb0-bd89-45d2-8f87-0fb94ca3f3dc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1fed7410-04b1-416e-b416-e4daa8825cb4 req-55213fb0-bd89-45d2-8f87-0fb94ca3f3dc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-1fed7410-04b1-416e-b416-e4daa8825cb4 req-55213fb0-bd89-45d2-8f87-0fb94ca3f3dc service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:02:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-1fed7410-04b1-416e-b416-e4daa8825cb4 req-55213fb0-bd89-45d2-8f87-0fb94ca3f3dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030835 Apr 14 03:02:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 92/274] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b323598c-4551-4f24-be2c-0588eaaad5ef req-c9145dfa-97c8-40cd-8d77-6c3aba0a32c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "65202a6a-2d5f-420b-a2bb-02ad01831633"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:14 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=38 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b323598c-4551-4f24-be2c-0588eaaad5ef req-c9145dfa-97c8-40cd-8d77-6c3aba0a32c1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b323598c-4551-4f24-be2c-0588eaaad5ef req-c9145dfa-97c8-40cd-8d77-6c3aba0a32c1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b323598c-4551-4f24-be2c-0588eaaad5ef req-c9145dfa-97c8-40cd-8d77-6c3aba0a32c1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:14 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b323598c-4551-4f24-be2c-0588eaaad5ef req-c9145dfa-97c8-40cd-8d77-6c3aba0a32c1 service nova] Creating event network-vif-plugged:65202a6a-2d5f-420b-a2bb-02ad01831633 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:02:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b323598c-4551-4f24-be2c-0588eaaad5ef req-c9145dfa-97c8-40cd-8d77-6c3aba0a32c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032366 Apr 14 03:02:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 93/275] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:17 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3d0a247a-2de8-4918-96f8-4a0727944b3b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:17 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3d0a247a-2de8-4918-96f8-4a0727944b3b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d0a247a-2de8-4918-96f8-4a0727944b3b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d0a247a-2de8-4918-96f8-4a0727944b3b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d0a247a-2de8-4918-96f8-4a0727944b3b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d0a247a-2de8-4918-96f8-4a0727944b3b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d0a247a-2de8-4918-96f8-4a0727944b3b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d0a247a-2de8-4918-96f8-4a0727944b3b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:17 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3d0a247a-2de8-4918-96f8-4a0727944b3b tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064488 Apr 14 03:02:17 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 91/276] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:02:17 2023] GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:02:18 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a HTTP/1.1 Apr 14 03:02:18 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:02:18 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:02:18 user devstack@n-api.service[61663]: Connection: close Apr 14 03:02:18 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:02:18 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:02:18 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:02:18 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:02:18 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:02:18 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:02:18 user devstack@n-api.service[61663]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:02:18 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:02:18 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:02:18 user devstack@n-api.service[61663]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:02:18 user devstack@n-api.service[61663]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:02:18 user devstack@n-api.service[61663]: method: > Apr 14 03:02:18 user devstack@n-api.service[61663]: exception: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61663]: action_args: {'id': 'bc99f782-81c1-4243-8853-5554e5663d0a'} Apr 14 03:02:18 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:02:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-79ddaca0-4927-45ac-89d5-7f28a1578428 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a" status: 404 len: 111 microversion: 2.1 time: 0.096288 Apr 14 03:02:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 93/277] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:18 2023] GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:02:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:18 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:02:18 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a HTTP/1.1 Apr 14 03:02:18 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:02:18 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:02:18 user devstack@n-api.service[61664]: Connection: close Apr 14 03:02:18 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:02:18 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:02:18 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:02:18 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:02:18 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:02:18 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:02:18 user devstack@n-api.service[61664]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:02:18 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:02:18 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:02:18 user devstack@n-api.service[61664]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:02:18 user devstack@n-api.service[61664]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:02:18 user devstack@n-api.service[61664]: method: > Apr 14 03:02:18 user devstack@n-api.service[61664]: exception: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61664]: action_args: {'id': 'bc99f782-81c1-4243-8853-5554e5663d0a'} Apr 14 03:02:18 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:02:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f8ab4d10-8066-4a96-b34f-ffce30f8dc8b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a" status: 404 len: 111 microversion: 2.1 time: 0.035476 Apr 14 03:02:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 94/278] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:02:18 2023] DELETE /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:02:18 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:18 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: bc99f782-81c1-4243-8853-5554e5663d0a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:18 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:02:18 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a HTTP/1.1 Apr 14 03:02:18 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:02:18 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:02:18 user devstack@n-api.service[61662]: Connection: close Apr 14 03:02:18 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:02:18 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:02:18 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:02:18 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:02:18 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:02:18 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:02:18 user devstack@n-api.service[61662]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:02:18 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:02:18 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:02:18 user devstack@n-api.service[61662]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:02:18 user devstack@n-api.service[61662]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:02:18 user devstack@n-api.service[61662]: method: > Apr 14 03:02:18 user devstack@n-api.service[61662]: exception: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61662]: action_args: {'id': 'bc99f782-81c1-4243-8853-5554e5663d0a'} Apr 14 03:02:18 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. Apr 14 03:02:18 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:02:18 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance bc99f782-81c1-4243-8853-5554e5663d0a could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:02:18 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-9a340738-1f4c-49ac-9f61-676ad0c9c8dc tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a" status: 404 len: 111 microversion: 2.1 time: 0.065154 Apr 14 03:02:18 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 92/279] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:18 2023] GET /compute/v2.1/servers/bc99f782-81c1-4243-8853-5554e5663d0a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:02:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-51f4c31b-71b8-4557-859f-01ce25319082 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-599123546"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:20 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-51f4c31b-71b8-4557-859f-01ce25319082 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-51f4c31b-71b8-4557-859f-01ce25319082 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-51f4c31b-71b8-4557-859f-01ce25319082 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-51f4c31b-71b8-4557-859f-01ce25319082 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-51f4c31b-71b8-4557-859f-01ce25319082 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-51f4c31b-71b8-4557-859f-01ce25319082 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-51f4c31b-71b8-4557-859f-01ce25319082 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-51f4c31b-71b8-4557-859f-01ce25319082 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/action" status: 202 len: 0 microversion: 2.1 time: 0.817274 Apr 14 03:02:21 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 94/280] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:02:20 2023] POST /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 03:02:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:21 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 8a826438-d96e-4e70-b50e-aca4be008394] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] HTTP exception thrown: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:02:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Request method failure captured: Apr 14 03:02:21 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394 HTTP/1.1 Apr 14 03:02:21 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:02:21 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:02:21 user devstack@n-api.service[61664]: Connection: close Apr 14 03:02:21 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:02:21 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:02:21 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:02:21 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:02:21 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMErwVvPJsjUJ3S0QPyBJwBGtPnN1VrL3KnPjbADURknqA0wkUZZ5eDBWtFcjFYFZZHeZil6ND7vyIhrBBYG50lpIyAGWg_8e4VgQYZfVgC3Jnm7MzkAyKb0p5axf2vM_aHXSvfx_x6W7PR7se8sYOcQ30uo0Jm_JeFuB_bek1E7GOY Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Project-Id: f021342634dd4f16bf2720533070154c Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f021342634dd4f16bf2720533070154c"}]}] Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Tenant: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Tenant-Id: f021342634dd4f16bf2720533070154c Apr 14 03:02:21 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:02:21 user devstack@n-api.service[61664]: X-User: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:02:21 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:02:21 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:02:21 user devstack@n-api.service[61664]: X-User-Id: 0dbce21e767a4a61b9213e38523d247e Apr 14 03:02:21 user devstack@n-api.service[61664]: X-User-Name: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:02:21 user devstack@n-api.service[61664]: method: > Apr 14 03:02:21 user devstack@n-api.service[61664]: exception: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:02:21 user devstack@n-api.service[61664]: action_args: {'id': '8a826438-d96e-4e70-b50e-aca4be008394'} Apr 14 03:02:21 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:02:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:02:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Returning 404 to user: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:02:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d490871c-4be2-48ac-840f-06668d7fed80 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394" status: 404 len: 111 microversion: 2.1 time: 0.029176 Apr 14 03:02:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:21 2023] GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:02:21 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b40f5a98-d554-4acf-b902-8aba959a1361 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:21 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-b40f5a98-d554-4acf-b902-8aba959a1361 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b40f5a98-d554-4acf-b902-8aba959a1361 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b40f5a98-d554-4acf-b902-8aba959a1361 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b40f5a98-d554-4acf-b902-8aba959a1361 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b40f5a98-d554-4acf-b902-8aba959a1361 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b40f5a98-d554-4acf-b902-8aba959a1361 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b40f5a98-d554-4acf-b902-8aba959a1361 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:21 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-b40f5a98-d554-4acf-b902-8aba959a1361 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbce21e767a4a61b9213e38523d247e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021342634dd4f16bf2720533070154c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b40f5a98-d554-4acf-b902-8aba959a1361 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b" status: 200 len: 1493 microversion: 2.1 time: 0.209405 Apr 14 03:02:22 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 93/282] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:21 2023] GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b => generated 1493 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:02:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1182227426", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "37bd0d93-b922-426c-8986-d86e886da69e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ea0f3bca-5794-46e4-a270-53dbe99375bd"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] validate_networks() for [('ea0f3bca-5794-46e4-a270-53dbe99375bd', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for user 60e11b7ab2914209b23bf7a53791da64 and project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:02:29 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37bd0d93-b922-426c-8986-d86e886da69e',volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:02:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-857e5d41-1823-4767-b53f-d73424560c86 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.784201 Apr 14 03:02:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 95/283] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:02:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:02:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9a96912a-8be0-45ec-9a4f-a11b82f5de56 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:29 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9a96912a-8be0-45ec-9a4f-a11b82f5de56 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:29 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-9a96912a-8be0-45ec-9a4f-a11b82f5de56 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9a96912a-8be0-45ec-9a4f-a11b82f5de56 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef" status: 200 len: 1066 microversion: 2.1 time: 0.083995 Apr 14 03:02:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 96/284] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:29 2023] GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef => generated 1066 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:02:31 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-653907637", "imageRef": "a7190884-2b37-45b0-a8e1-4e55a042e5ea", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1951210375", "security_groups": [{"name": "tempest-secgroup-smoke-123551073"}], "networks": [{"uuid": "516bab80-c2e3-4a1c-9181-5eae563a4ae5"}]}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:31 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] validate_networks() for [('516bab80-c2e3-4a1c-9181-5eae563a4ae5', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:02:31 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=15 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Getting quotas for project 6371b4c05df843da9b134e12994c1d7a. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Getting quotas for user 337e2d8118324215b5a0baa36a5895b0 and project 6371b4c05df843da9b134e12994c1d7a. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a7190884-2b37-45b0-a8e1-4e55a042e5ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:02:32 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-96eb799b-e92b-4fab-a5ac-cc2f24b73120 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.632487 Apr 14 03:02:32 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 94/285] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:02:31 2023] POST /compute/v2.1/servers => generated 403 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:02:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-62424f5e-1cb8-41c9-bbc6-6191d9b1f24e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-62424f5e-1cb8-41c9-bbc6-6191d9b1f24e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:32 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-62424f5e-1cb8-41c9-bbc6-6191d9b1f24e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337e2d8118324215b5a0baa36a5895b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6371b4c05df843da9b134e12994c1d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-62424f5e-1cb8-41c9-bbc6-6191d9b1f24e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d" status: 200 len: 1236 microversion: 2.1 time: 0.057442 Apr 14 03:02:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 96/286] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:32 2023] GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d => generated 1236 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:02:32 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=5 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-540f95db-0c16-46bf-98a5-7223ec5ad24d req-c376ae15-4d46-4bca-ba61-70632c44e62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f970adb1-fe1b-4b58-83aa-45207a6211ef", "tag": "e51353cf-a5e9-41e4-9b6e-4a022984af76"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-540f95db-0c16-46bf-98a5-7223ec5ad24d req-c376ae15-4d46-4bca-ba61-70632c44e62c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-540f95db-0c16-46bf-98a5-7223ec5ad24d req-c376ae15-4d46-4bca-ba61-70632c44e62c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-540f95db-0c16-46bf-98a5-7223ec5ad24d req-c376ae15-4d46-4bca-ba61-70632c44e62c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-540f95db-0c16-46bf-98a5-7223ec5ad24d req-c376ae15-4d46-4bca-ba61-70632c44e62c service nova] Creating event network-changed:e51353cf-a5e9-41e4-9b6e-4a022984af76 for instance f970adb1-fe1b-4b58-83aa-45207a6211ef on user Apr 14 03:02:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-540f95db-0c16-46bf-98a5-7223ec5ad24d req-c376ae15-4d46-4bca-ba61-70632c44e62c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062319 Apr 14 03:02:32 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 97/287] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:33 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:33 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:33 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:33 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-656060e4-4de8-4e3e-b37f-3a391068bb48 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a" status: 200 len: 2822 microversion: 2.32 time: 0.417604 Apr 14 03:02:33 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 95/288] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:02:32 2023] GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a => generated 2822 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:02:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-f4e4d079-10eb-40c6-859f-b9a100b4168b req-f08c18bc-ee39-442c-b335-d39ee2da2550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8c2e40-f896-4d21-9927-67330485d77d", "tag": "a36f717a-9a8b-43c9-ba01-0f03a522d166"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f4e4d079-10eb-40c6-859f-b9a100b4168b req-f08c18bc-ee39-442c-b335-d39ee2da2550 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f4e4d079-10eb-40c6-859f-b9a100b4168b req-f08c18bc-ee39-442c-b335-d39ee2da2550 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f4e4d079-10eb-40c6-859f-b9a100b4168b req-f08c18bc-ee39-442c-b335-d39ee2da2550 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f4e4d079-10eb-40c6-859f-b9a100b4168b req-f08c18bc-ee39-442c-b335-d39ee2da2550 service nova] Creating event network-changed:a36f717a-9a8b-43c9-ba01-0f03a522d166 for instance dc8c2e40-f896-4d21-9927-67330485d77d on user Apr 14 03:02:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-f4e4d079-10eb-40c6-859f-b9a100b4168b req-f08c18bc-ee39-442c-b335-d39ee2da2550 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028030 Apr 14 03:02:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 97/289] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-47767dee-b000-44a3-a222-f1f227b0dd5d req-98eaafa2-8690-4d3f-92b1-eb4e1b07ec7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8c2e40-f896-4d21-9927-67330485d77d", "name": "network-vif-plugged", "status": "completed", "tag": "a36f717a-9a8b-43c9-ba01-0f03a522d166"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-47767dee-b000-44a3-a222-f1f227b0dd5d req-98eaafa2-8690-4d3f-92b1-eb4e1b07ec7d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-47767dee-b000-44a3-a222-f1f227b0dd5d req-98eaafa2-8690-4d3f-92b1-eb4e1b07ec7d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-47767dee-b000-44a3-a222-f1f227b0dd5d req-98eaafa2-8690-4d3f-92b1-eb4e1b07ec7d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-47767dee-b000-44a3-a222-f1f227b0dd5d req-98eaafa2-8690-4d3f-92b1-eb4e1b07ec7d service nova] Creating event network-vif-plugged:a36f717a-9a8b-43c9-ba01-0f03a522d166 for instance dc8c2e40-f896-4d21-9927-67330485d77d on user Apr 14 03:02:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-47767dee-b000-44a3-a222-f1f227b0dd5d req-98eaafa2-8690-4d3f-92b1-eb4e1b07ec7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033507 Apr 14 03:02:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 98/290] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:39 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-2e93b45c-b044-4de1-9208-af8544d0875f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:39 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-2e93b45c-b044-4de1-9208-af8544d0875f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2e93b45c-b044-4de1-9208-af8544d0875f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2e93b45c-b044-4de1-9208-af8544d0875f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2e93b45c-b044-4de1-9208-af8544d0875f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2e93b45c-b044-4de1-9208-af8544d0875f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2e93b45c-b044-4de1-9208-af8544d0875f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2e93b45c-b044-4de1-9208-af8544d0875f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:39 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-2e93b45c-b044-4de1-9208-af8544d0875f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:39 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-2e93b45c-b044-4de1-9208-af8544d0875f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1701 microversion: 2.1 time: 0.231737 Apr 14 03:02:39 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 96/291] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:39 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1701 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:02:40 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3c7153f1-3f6c-4b31-a985-d441ca6ca470 req-bb3c4440-b4b4-4b9a-9eff-a2c1b88d65bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f970adb1-fe1b-4b58-83aa-45207a6211ef", "name": "network-vif-plugged", "status": "completed", "tag": "e51353cf-a5e9-41e4-9b6e-4a022984af76"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3c7153f1-3f6c-4b31-a985-d441ca6ca470 req-bb3c4440-b4b4-4b9a-9eff-a2c1b88d65bc service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3c7153f1-3f6c-4b31-a985-d441ca6ca470 req-bb3c4440-b4b4-4b9a-9eff-a2c1b88d65bc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3c7153f1-3f6c-4b31-a985-d441ca6ca470 req-bb3c4440-b4b4-4b9a-9eff-a2c1b88d65bc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3c7153f1-3f6c-4b31-a985-d441ca6ca470 req-bb3c4440-b4b4-4b9a-9eff-a2c1b88d65bc service nova] Creating event network-vif-plugged:e51353cf-a5e9-41e4-9b6e-4a022984af76 for instance f970adb1-fe1b-4b58-83aa-45207a6211ef on user Apr 14 03:02:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3c7153f1-3f6c-4b31-a985-d441ca6ca470 req-bb3c4440-b4b4-4b9a-9eff-a2c1b88d65bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047930 Apr 14 03:02:40 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 98/292] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:40 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-6caa6191-7e3e-479b-922d-080bb6bb255b req-7017275a-71ec-4440-8969-00638d986479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8c2e40-f896-4d21-9927-67330485d77d", "name": "network-vif-plugged", "status": "completed", "tag": "a36f717a-9a8b-43c9-ba01-0f03a522d166"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6caa6191-7e3e-479b-922d-080bb6bb255b req-7017275a-71ec-4440-8969-00638d986479 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6caa6191-7e3e-479b-922d-080bb6bb255b req-7017275a-71ec-4440-8969-00638d986479 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6caa6191-7e3e-479b-922d-080bb6bb255b req-7017275a-71ec-4440-8969-00638d986479 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6caa6191-7e3e-479b-922d-080bb6bb255b req-7017275a-71ec-4440-8969-00638d986479 service nova] Creating event network-vif-plugged:a36f717a-9a8b-43c9-ba01-0f03a522d166 for instance dc8c2e40-f896-4d21-9927-67330485d77d on user Apr 14 03:02:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-6caa6191-7e3e-479b-922d-080bb6bb255b req-7017275a-71ec-4440-8969-00638d986479 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030457 Apr 14 03:02:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 99/293] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:42 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-77629780-4add-4bb8-9974-414a12607e89 req-e15c88c3-b79e-4c7d-9b93-120b55b7e56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f970adb1-fe1b-4b58-83aa-45207a6211ef", "name": "network-vif-plugged", "status": "completed", "tag": "e51353cf-a5e9-41e4-9b6e-4a022984af76"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:42 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:42 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-77629780-4add-4bb8-9974-414a12607e89 req-e15c88c3-b79e-4c7d-9b93-120b55b7e56e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-77629780-4add-4bb8-9974-414a12607e89 req-e15c88c3-b79e-4c7d-9b93-120b55b7e56e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-77629780-4add-4bb8-9974-414a12607e89 req-e15c88c3-b79e-4c7d-9b93-120b55b7e56e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:42 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-77629780-4add-4bb8-9974-414a12607e89 req-e15c88c3-b79e-4c7d-9b93-120b55b7e56e service nova] Creating event network-vif-plugged:e51353cf-a5e9-41e4-9b6e-4a022984af76 for instance f970adb1-fe1b-4b58-83aa-45207a6211ef on user Apr 14 03:02:42 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-77629780-4add-4bb8-9974-414a12607e89 req-e15c88c3-b79e-4c7d-9b93-120b55b7e56e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039283 Apr 14 03:02:42 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 97/294] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-37078be6-0085-4451-8582-9907b67567f1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-37078be6-0085-4451-8582-9907b67567f1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37078be6-0085-4451-8582-9907b67567f1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37078be6-0085-4451-8582-9907b67567f1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37078be6-0085-4451-8582-9907b67567f1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37078be6-0085-4451-8582-9907b67567f1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37078be6-0085-4451-8582-9907b67567f1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37078be6-0085-4451-8582-9907b67567f1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-37078be6-0085-4451-8582-9907b67567f1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lazy-loading 'flavor' on Instance uuid 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:02:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-37078be6-0085-4451-8582-9907b67567f1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6/action" status: 200 len: 32 microversion: 2.1 time: 0.146188 Apr 14 03:02:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 99/295] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:02:42 2023] POST /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:02:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f7cb9a82-5da8-4829-b531-99aec46706f2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f7cb9a82-5da8-4829-b531-99aec46706f2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f7cb9a82-5da8-4829-b531-99aec46706f2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f7cb9a82-5da8-4829-b531-99aec46706f2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f7cb9a82-5da8-4829-b531-99aec46706f2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f7cb9a82-5da8-4829-b531-99aec46706f2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f7cb9a82-5da8-4829-b531-99aec46706f2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f7cb9a82-5da8-4829-b531-99aec46706f2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:43 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-f7cb9a82-5da8-4829-b531-99aec46706f2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f7cb9a82-5da8-4829-b531-99aec46706f2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6" status: 200 len: 1509 microversion: 2.1 time: 0.654937 Apr 14 03:02:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 100/296] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:42 2023] GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 => generated 1509 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:02:44 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-575a231e-63bb-4417-840a-f582897f7659 req-1429653c-b10b-4bf9-ac13-2926d5d7a794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-unplugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}, {"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-575a231e-63bb-4417-840a-f582897f7659 req-1429653c-b10b-4bf9-ac13-2926d5d7a794 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-575a231e-63bb-4417-840a-f582897f7659 req-1429653c-b10b-4bf9-ac13-2926d5d7a794 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-575a231e-63bb-4417-840a-f582897f7659 req-1429653c-b10b-4bf9-ac13-2926d5d7a794 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-575a231e-63bb-4417-840a-f582897f7659 req-1429653c-b10b-4bf9-ac13-2926d5d7a794 service nova] Creating event network-vif-unplugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:02:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-575a231e-63bb-4417-840a-f582897f7659 req-1429653c-b10b-4bf9-ac13-2926d5d7a794 service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:02:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-575a231e-63bb-4417-840a-f582897f7659 req-1429653c-b10b-4bf9-ac13-2926d5d7a794 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039964 Apr 14 03:02:44 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 98/297] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:44 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-664bf3a2-1bc4-4952-b4fc-ade4a0438d79 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-664bf3a2-1bc4-4952-b4fc-ade4a0438d79 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-664bf3a2-1bc4-4952-b4fc-ade4a0438d79 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-664bf3a2-1bc4-4952-b4fc-ade4a0438d79 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-664bf3a2-1bc4-4952-b4fc-ade4a0438d79 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-664bf3a2-1bc4-4952-b4fc-ade4a0438d79 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-664bf3a2-1bc4-4952-b4fc-ade4a0438d79 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-664bf3a2-1bc4-4952-b4fc-ade4a0438d79 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:46 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-664bf3a2-1bc4-4952-b4fc-ade4a0438d79 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-664bf3a2-1bc4-4952-b4fc-ade4a0438d79 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1721 microversion: 2.1 time: 0.266553 Apr 14 03:02:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 100/298] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:45 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:02:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-071d6d55-47b8-4555-9358-dc44123cdc93 req-3c76f636-a1d7-4558-9e38-8db5d4a08524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}, {"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:02:46 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=18 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-071d6d55-47b8-4555-9358-dc44123cdc93 req-3c76f636-a1d7-4558-9e38-8db5d4a08524 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-071d6d55-47b8-4555-9358-dc44123cdc93 req-3c76f636-a1d7-4558-9e38-8db5d4a08524 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-071d6d55-47b8-4555-9358-dc44123cdc93 req-3c76f636-a1d7-4558-9e38-8db5d4a08524 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-071d6d55-47b8-4555-9358-dc44123cdc93 req-3c76f636-a1d7-4558-9e38-8db5d4a08524 service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:02:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-071d6d55-47b8-4555-9358-dc44123cdc93 req-3c76f636-a1d7-4558-9e38-8db5d4a08524 service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:02:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-071d6d55-47b8-4555-9358-dc44123cdc93 req-3c76f636-a1d7-4558-9e38-8db5d4a08524 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038842 Apr 14 03:02:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 101/299] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:02:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-64f649a9-dde5-4ec2-947c-04f784c7c0ea tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:02:46 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-64f649a9-dde5-4ec2-947c-04f784c7c0ea tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:02:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-64f649a9-dde5-4ec2-947c-04f784c7c0ea tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-64f649a9-dde5-4ec2-947c-04f784c7c0ea tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-64f649a9-dde5-4ec2-947c-04f784c7c0ea tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-64f649a9-dde5-4ec2-947c-04f784c7c0ea tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:02:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-64f649a9-dde5-4ec2-947c-04f784c7c0ea tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:02:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-64f649a9-dde5-4ec2-947c-04f784c7c0ea tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:02:46 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-64f649a9-dde5-4ec2-947c-04f784c7c0ea tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f089c5c093754f8082181a8fc1c002f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f987064bf0ed4a2fa8714064fe8b43c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:02:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-64f649a9-dde5-4ec2-947c-04f784c7c0ea tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49" status: 200 len: 1524 microversion: 2.1 time: 0.158426 Apr 14 03:02:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 99/300] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:02:46 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 => generated 1524 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9f8127e3-8945-4981-8c0f-0796caa6a80c"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] [instance: 287a236d-d191-465f-bb65-636732ce5689] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] HTTP exception thrown: Volume 2d16b877-9a78-4232-8d08-fbb5b0933630 could not be found. Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Request method failure captured: Apr 14 03:03:03 user devstack@n-api.service[61663]: request: PUT /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689/os-volume_attachments/2d16b877-9a78-4232-8d08-fbb5b0933630 HTTP/1.1 Apr 14 03:03:03 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:03:03 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:03:03 user devstack@n-api.service[61663]: Connection: close Apr 14 03:03:03 user devstack@n-api.service[61663]: Content-Length: 74 Apr 14 03:03:03 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:03:03 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:03:03 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:03:03 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMFA8ByMyuqVnRBOCAj5v4u3WaAtbJyxtaeeauJGicWUTF5rHtW4lEpCeViubYzp-Ba6emhiIwRSTNX3ndAmhym2LGhQ7En9Z5A33v-TAXlkZYof7hoD_KbAs7xRkO6VY2U1_HNVYCS8zExJZc_TiXss-KjKrHCYaaru_M8ZHoUr5jI Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Project-Id: 9e84140dc06645eca8fda16056a8c4af Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesAdminNegativeTest-2070066656 Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Role: admin,reader,member Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Roles: admin,reader,member Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e84140dc06645eca8fda16056a8c4af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e84140dc06645eca8fda16056a8c4af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e84140dc06645eca8fda16056a8c4af"}]}] Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesAdminNegativeTest-2070066656 Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Tenant-Id: 9e84140dc06645eca8fda16056a8c4af Apr 14 03:03:03 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2070066656 Apr 14 03:03:03 user devstack@n-api.service[61663]: X-User: tempest-VolumesAdminNegativeTest-2070066656-project-admin Apr 14 03:03:03 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:03:03 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:03:03 user devstack@n-api.service[61663]: X-User-Id: a5d3018ea16143d98508167b17d3314f Apr 14 03:03:03 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesAdminNegativeTest-2070066656-project-admin Apr 14 03:03:03 user devstack@n-api.service[61663]: Apr 14 03:03:03 user devstack@n-api.service[61663]: {"volumeAttachment": {"volumeId": "9f8127e3-8945-4981-8c0f-0796caa6a80c"}} Apr 14 03:03:03 user devstack@n-api.service[61663]: method: > Apr 14 03:03:03 user devstack@n-api.service[61663]: exception: Volume 2d16b877-9a78-4232-8d08-fbb5b0933630 could not be found. Apr 14 03:03:03 user devstack@n-api.service[61663]: action_args: {'server_id': '287a236d-d191-465f-bb65-636732ce5689', 'id': '2d16b877-9a78-4232-8d08-fbb5b0933630', 'body': {'volumeAttachment': {'volumeId': '9f8127e3-8945-4981-8c0f-0796caa6a80c'}}} Apr 14 03:03:03 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d16b877-9a78-4232-8d08-fbb5b0933630 could not be found. (HTTP 404) (Request-ID: req-cbe03f40-5c7a-47ee-9a6d-fe6fac002c6f) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d16b877-9a78-4232-8d08-fbb5b0933630 could not be found. Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d16b877-9a78-4232-8d08-fbb5b0933630 could not be found. Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d16b877-9a78-4232-8d08-fbb5b0933630 could not be found. Apr 14 03:03:03 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:03:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] Returning 404 to user: Volume 2d16b877-9a78-4232-8d08-fbb5b0933630 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:03:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1dba8d34-2b14-47ce-89fe-4fe194dfac5e tempest-VolumesAdminNegativeTest-2070066656 tempest-VolumesAdminNegativeTest-2070066656-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689/os-volume_attachments/2d16b877-9a78-4232-8d08-fbb5b0933630" status: 404 len: 109 microversion: 2.1 time: 0.111277 Apr 14 03:03:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 101/301] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 03:03:03 2023] PUT /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689/os-volume_attachments/2d16b877-9a78-4232-8d08-fbb5b0933630 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=14 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c7fbaf77-f26d-4a19-9d05-00bde0ee120f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c7fbaf77-f26d-4a19-9d05-00bde0ee120f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 287a236d-d191-465f-bb65-636732ce5689] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c7fbaf77-f26d-4a19-9d05-00bde0ee120f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c7fbaf77-f26d-4a19-9d05-00bde0ee120f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c7fbaf77-f26d-4a19-9d05-00bde0ee120f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c7fbaf77-f26d-4a19-9d05-00bde0ee120f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c7fbaf77-f26d-4a19-9d05-00bde0ee120f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c7fbaf77-f26d-4a19-9d05-00bde0ee120f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:06 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c7fbaf77-f26d-4a19-9d05-00bde0ee120f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 287a236d-d191-465f-bb65-636732ce5689] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:03:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c7fbaf77-f26d-4a19-9d05-00bde0ee120f tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689" status: 204 len: 0 microversion: 2.1 time: 0.128846 Apr 14 03:03:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 102/302] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:03:06 2023] DELETE /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:03:06 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a6a837ca-f21c-46f2-91b7-524afb847071 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:06 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-a6a837ca-f21c-46f2-91b7-524afb847071 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 287a236d-d191-465f-bb65-636732ce5689] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:06 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=5 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:06 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=24 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6a837ca-f21c-46f2-91b7-524afb847071 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6a837ca-f21c-46f2-91b7-524afb847071 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6a837ca-f21c-46f2-91b7-524afb847071 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6a837ca-f21c-46f2-91b7-524afb847071 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6a837ca-f21c-46f2-91b7-524afb847071 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6a837ca-f21c-46f2-91b7-524afb847071 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:07 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-a6a837ca-f21c-46f2-91b7-524afb847071 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d4916eb93c4b3ebbbd2af4b0cdacc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1eb61159b43228db0d529a5be816d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:07 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a6a837ca-f21c-46f2-91b7-524afb847071 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689" status: 200 len: 1502 microversion: 2.1 time: 0.163195 Apr 14 03:03:07 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 100/303] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:03:06 2023] GET /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:03:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ad8903af-c170-4439-9d98-b7a946963ac7 req-a0c8d9ec-6ac7-439a-af34-0dee074c1e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287a236d-d191-465f-bb65-636732ce5689", "name": "network-vif-unplugged", "status": "completed", "tag": "7a4cd76a-7605-4209-9dd2-ec4bced26f20"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ad8903af-c170-4439-9d98-b7a946963ac7 req-a0c8d9ec-6ac7-439a-af34-0dee074c1e5f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ad8903af-c170-4439-9d98-b7a946963ac7 req-a0c8d9ec-6ac7-439a-af34-0dee074c1e5f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ad8903af-c170-4439-9d98-b7a946963ac7 req-a0c8d9ec-6ac7-439a-af34-0dee074c1e5f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ad8903af-c170-4439-9d98-b7a946963ac7 req-a0c8d9ec-6ac7-439a-af34-0dee074c1e5f service nova] Creating event network-vif-unplugged:7a4cd76a-7605-4209-9dd2-ec4bced26f20 for instance 287a236d-d191-465f-bb65-636732ce5689 on user Apr 14 03:03:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ad8903af-c170-4439-9d98-b7a946963ac7 req-a0c8d9ec-6ac7-439a-af34-0dee074c1e5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109625 Apr 14 03:03:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 102/304] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9463dbdf-696c-42ac-9cfe-ab997a85a442 req-57f8fd3f-2365-4f17-b84d-4ac109c032fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287a236d-d191-465f-bb65-636732ce5689", "name": "network-vif-deleted", "tag": "7a4cd76a-7605-4209-9dd2-ec4bced26f20"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9463dbdf-696c-42ac-9cfe-ab997a85a442 req-57f8fd3f-2365-4f17-b84d-4ac109c032fb service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9463dbdf-696c-42ac-9cfe-ab997a85a442 req-57f8fd3f-2365-4f17-b84d-4ac109c032fb service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9463dbdf-696c-42ac-9cfe-ab997a85a442 req-57f8fd3f-2365-4f17-b84d-4ac109c032fb service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9463dbdf-696c-42ac-9cfe-ab997a85a442 req-57f8fd3f-2365-4f17-b84d-4ac109c032fb service nova] Creating event network-vif-deleted:7a4cd76a-7605-4209-9dd2-ec4bced26f20 for instance 287a236d-d191-465f-bb65-636732ce5689 on user Apr 14 03:03:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9463dbdf-696c-42ac-9cfe-ab997a85a442 req-57f8fd3f-2365-4f17-b84d-4ac109c032fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127282 Apr 14 03:03:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 103/305] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:09 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-b38513ff-64bf-4c8e-94f3-5df5743212c9 req-8acd3a48-8190-4425-b113-7fed66720611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287a236d-d191-465f-bb65-636732ce5689", "name": "network-vif-plugged", "status": "completed", "tag": "7a4cd76a-7605-4209-9dd2-ec4bced26f20"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b38513ff-64bf-4c8e-94f3-5df5743212c9 req-8acd3a48-8190-4425-b113-7fed66720611 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b38513ff-64bf-4c8e-94f3-5df5743212c9 req-8acd3a48-8190-4425-b113-7fed66720611 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b38513ff-64bf-4c8e-94f3-5df5743212c9 req-8acd3a48-8190-4425-b113-7fed66720611 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:09 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-b38513ff-64bf-4c8e-94f3-5df5743212c9 req-8acd3a48-8190-4425-b113-7fed66720611 service nova] Creating event network-vif-plugged:7a4cd76a-7605-4209-9dd2-ec4bced26f20 for instance 287a236d-d191-465f-bb65-636732ce5689 on user Apr 14 03:03:09 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-b38513ff-64bf-4c8e-94f3-5df5743212c9 req-8acd3a48-8190-4425-b113-7fed66720611 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027685 Apr 14 03:03:09 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 101/306] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-2cf8157b-35ef-4eea-b932-477d178a0978 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-2cf8157b-35ef-4eea-b932-477d178a0978 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2cf8157b-35ef-4eea-b932-477d178a0978 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2cf8157b-35ef-4eea-b932-477d178a0978 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2cf8157b-35ef-4eea-b932-477d178a0978 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2cf8157b-35ef-4eea-b932-477d178a0978 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2cf8157b-35ef-4eea-b932-477d178a0978 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2cf8157b-35ef-4eea-b932-477d178a0978 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:19 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-2cf8157b-35ef-4eea-b932-477d178a0978 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-2cf8157b-35ef-4eea-b932-477d178a0978 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef" status: 200 len: 1394 microversion: 2.1 time: 0.154725 Apr 14 03:03:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 103/307] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:03:19 2023] GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef => generated 1394 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-79bc1a78-d465-46d3-9ad1-d155b80d5a05 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-79bc1a78-d465-46d3-9ad1-d155b80d5a05 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79bc1a78-d465-46d3-9ad1-d155b80d5a05 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79bc1a78-d465-46d3-9ad1-d155b80d5a05 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79bc1a78-d465-46d3-9ad1-d155b80d5a05 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79bc1a78-d465-46d3-9ad1-d155b80d5a05 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79bc1a78-d465-46d3-9ad1-d155b80d5a05 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79bc1a78-d465-46d3-9ad1-d155b80d5a05 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:22 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-79bc1a78-d465-46d3-9ad1-d155b80d5a05 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337e2d8118324215b5a0baa36a5895b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6371b4c05df843da9b134e12994c1d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-79bc1a78-d465-46d3-9ad1-d155b80d5a05 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d" status: 200 len: 1536 microversion: 2.1 time: 0.176436 Apr 14 03:03:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 104/308] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:03:22 2023] GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d => generated 1536 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:03:24 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:24 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=8 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-accbb2fc-f134-40dc-9e5e-de7a6483cd69 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-129284653", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b79b29ca-aed8-4f63-87e4-2088158dca75", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "47266f26-ea7c-404a-9098-264e4a1e0ab6"}]}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-accbb2fc-f134-40dc-9e5e-de7a6483cd69 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] HTTP exception thrown: Block Device b79b29ca-aed8-4f63-87e4-2088158dca75 is not bootable. Apr 14 03:03:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-accbb2fc-f134-40dc-9e5e-de7a6483cd69 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Request method failure captured: Apr 14 03:03:24 user devstack@n-api.service[61662]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 03:03:24 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:03:24 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:03:24 user devstack@n-api.service[61662]: Connection: close Apr 14 03:03:24 user devstack@n-api.service[61662]: Content-Length: 356 Apr 14 03:03:24 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:03:24 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:03:24 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:03:24 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMErwVvPJsjUJ3S0QPyBJwBGtPnN1VrL3KnPjbADURknqA0wkUZZ5eDBWtFcjFYFZZHeZil6ND7vyIhrBBYG50lpIyAGWg_8e4VgQYZfVgC3Jnm7MzkAyKb0p5axf2vM_aHXSvfx_x6W7PR7se8sYOcQ30uo0Jm_JeFuB_bek1E7GOY Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Project-Id: f021342634dd4f16bf2720533070154c Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Project-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f021342634dd4f16bf2720533070154c"}]}] Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Tenant: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Tenant-Id: f021342634dd4f16bf2720533070154c Apr 14 03:03:24 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:03:24 user devstack@n-api.service[61662]: X-User: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:03:24 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:03:24 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:03:24 user devstack@n-api.service[61662]: X-User-Id: 0dbce21e767a4a61b9213e38523d247e Apr 14 03:03:24 user devstack@n-api.service[61662]: X-User-Name: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:03:24 user devstack@n-api.service[61662]: Apr 14 03:03:24 user devstack@n-api.service[61662]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-129284653", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b79b29ca-aed8-4f63-87e4-2088158dca75", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "47266f26-ea7c-404a-9098-264e4a1e0ab6"}]}} Apr 14 03:03:24 user devstack@n-api.service[61662]: method: > Apr 14 03:03:24 user devstack@n-api.service[61662]: exception: Block Device b79b29ca-aed8-4f63-87e4-2088158dca75 is not bootable. Apr 14 03:03:24 user devstack@n-api.service[61662]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-129284653', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'b79b29ca-aed8-4f63-87e4-2088158dca75'}], 'networks': [{'uuid': '47266f26-ea7c-404a-9098-264e4a1e0ab6'}]}}} Apr 14 03:03:24 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device b79b29ca-aed8-4f63-87e4-2088158dca75 is not bootable. Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device b79b29ca-aed8-4f63-87e4-2088158dca75 is not bootable. Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device b79b29ca-aed8-4f63-87e4-2088158dca75 is not bootable. Apr 14 03:03:24 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:03:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-accbb2fc-f134-40dc-9e5e-de7a6483cd69 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Returning 400 to user: Block Device b79b29ca-aed8-4f63-87e4-2088158dca75 is not bootable. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:03:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-accbb2fc-f134-40dc-9e5e-de7a6483cd69 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.122948 Apr 14 03:03:24 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 102/309] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:03:24 2023] POST /compute/v2.1/servers => generated 110 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:03:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5f9ec4b0-7f28-4415-be52-1de190bd0559 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:24 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5f9ec4b0-7f28-4415-be52-1de190bd0559 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f9ec4b0-7f28-4415-be52-1de190bd0559 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f9ec4b0-7f28-4415-be52-1de190bd0559 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f9ec4b0-7f28-4415-be52-1de190bd0559 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f9ec4b0-7f28-4415-be52-1de190bd0559 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f9ec4b0-7f28-4415-be52-1de190bd0559 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f9ec4b0-7f28-4415-be52-1de190bd0559 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:24 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-5f9ec4b0-7f28-4415-be52-1de190bd0559 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbce21e767a4a61b9213e38523d247e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021342634dd4f16bf2720533070154c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5f9ec4b0-7f28-4415-be52-1de190bd0559 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b" status: 200 len: 1493 microversion: 2.1 time: 0.146286 Apr 14 03:03:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 104/310] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:03:24 2023] GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b => generated 1493 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:33 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-835882cf-0486-4183-8387-5220ff022fe8 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:33 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-835882cf-0486-4183-8387-5220ff022fe8 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-835882cf-0486-4183-8387-5220ff022fe8 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-835882cf-0486-4183-8387-5220ff022fe8 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-835882cf-0486-4183-8387-5220ff022fe8 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-835882cf-0486-4183-8387-5220ff022fe8 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-835882cf-0486-4183-8387-5220ff022fe8 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-835882cf-0486-4183-8387-5220ff022fe8 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b60aa549-28ab-438b-b71b-afb2c5e1080c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b60aa549-28ab-438b-b71b-afb2c5e1080c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b60aa549-28ab-438b-b71b-afb2c5e1080c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b60aa549-28ab-438b-b71b-afb2c5e1080c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b60aa549-28ab-438b-b71b-afb2c5e1080c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b60aa549-28ab-438b-b71b-afb2c5e1080c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b60aa549-28ab-438b-b71b-afb2c5e1080c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b60aa549-28ab-438b-b71b-afb2c5e1080c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:33 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-835882cf-0486-4183-8387-5220ff022fe8 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.137587 Apr 14 03:03:33 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 103/311] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 03:03:33 2023] GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a/os-interface => generated 1829 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:03:33 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b60aa549-28ab-438b-b71b-afb2c5e1080c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b60aa549-28ab-438b-b71b-afb2c5e1080c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6" status: 200 len: 1489 microversion: 2.1 time: 0.313325 Apr 14 03:03:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 105/312] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:03:33 2023] GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 => generated 1489 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:03:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-739a85e7-a861-44da-9a44-21dedf620262 req-08475563-c6ff-4ca5-a14c-091d168e2a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "tag": "7e8d8948-ff3b-461a-921a-d90f46d9f84c"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-739a85e7-a861-44da-9a44-21dedf620262 req-08475563-c6ff-4ca5-a14c-091d168e2a18 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-739a85e7-a861-44da-9a44-21dedf620262 req-08475563-c6ff-4ca5-a14c-091d168e2a18 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-739a85e7-a861-44da-9a44-21dedf620262 req-08475563-c6ff-4ca5-a14c-091d168e2a18 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-739a85e7-a861-44da-9a44-21dedf620262 req-08475563-c6ff-4ca5-a14c-091d168e2a18 service nova] Creating event network-changed:7e8d8948-ff3b-461a-921a-d90f46d9f84c for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-739a85e7-a861-44da-9a44-21dedf620262 req-08475563-c6ff-4ca5-a14c-091d168e2a18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036540 Apr 14 03:03:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 105/313] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:34 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-fe75e250-f918-4b66-9df8-2c69bcd3e71f tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a" status: 200 len: 2822 microversion: 2.32 time: 0.225882 Apr 14 03:03:34 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 104/314] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:03:34 2023] GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a => generated 2822 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:03:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-bfcc641a-59a8-4972-a5da-fe323566b079 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:34 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-bfcc641a-59a8-4972-a5da-fe323566b079 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bfcc641a-59a8-4972-a5da-fe323566b079 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bfcc641a-59a8-4972-a5da-fe323566b079 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bfcc641a-59a8-4972-a5da-fe323566b079 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bfcc641a-59a8-4972-a5da-fe323566b079 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bfcc641a-59a8-4972-a5da-fe323566b079 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bfcc641a-59a8-4972-a5da-fe323566b079 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-bfcc641a-59a8-4972-a5da-fe323566b079 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.190701 Apr 14 03:03:34 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 106/315] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 03:03:34 2023] GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a/os-interface => generated 1829 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ca8f998b-c574-4c82-9b90-52772525f81c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ca8f998b-c574-4c82-9b90-52772525f81c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca8f998b-c574-4c82-9b90-52772525f81c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca8f998b-c574-4c82-9b90-52772525f81c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca8f998b-c574-4c82-9b90-52772525f81c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca8f998b-c574-4c82-9b90-52772525f81c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca8f998b-c574-4c82-9b90-52772525f81c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca8f998b-c574-4c82-9b90-52772525f81c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ca8f998b-c574-4c82-9b90-52772525f81c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:03:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ca8f998b-c574-4c82-9b90-52772525f81c tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a" status: 204 len: 0 microversion: 2.32 time: 0.115728 Apr 14 03:03:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 106/316] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:03:35 2023] DELETE /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:36 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3c342144e51496190e32329225ddd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d10e0d7e7477484e4204841a3980c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:36 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-04e020f7-0fdb-4c6b-a545-4342e6d3397e tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a" status: 200 len: 2947 microversion: 2.32 time: 0.235480 Apr 14 03:03:36 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 105/317] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:03:36 2023] GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a => generated 2947 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:03:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f60fcdc3-c2bc-479a-84cb-451d1aa131aa req-9f2571cf-c54a-4599-aa8c-b66fa19e3afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-unplugged", "status": "completed", "tag": "7e8d8948-ff3b-461a-921a-d90f46d9f84c"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f60fcdc3-c2bc-479a-84cb-451d1aa131aa req-9f2571cf-c54a-4599-aa8c-b66fa19e3afc service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f60fcdc3-c2bc-479a-84cb-451d1aa131aa req-9f2571cf-c54a-4599-aa8c-b66fa19e3afc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f60fcdc3-c2bc-479a-84cb-451d1aa131aa req-9f2571cf-c54a-4599-aa8c-b66fa19e3afc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f60fcdc3-c2bc-479a-84cb-451d1aa131aa req-9f2571cf-c54a-4599-aa8c-b66fa19e3afc service nova] Creating event network-vif-unplugged:7e8d8948-ff3b-461a-921a-d90f46d9f84c for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f60fcdc3-c2bc-479a-84cb-451d1aa131aa req-9f2571cf-c54a-4599-aa8c-b66fa19e3afc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037576 Apr 14 03:03:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 107/318] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-55f45afc-99b2-4d8d-9207-824ca1bde700 req-d1e76edf-cb31-4acf-9331-487bf35557d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-unplugged", "status": "completed", "tag": "5b8574e2-f175-4432-a1cb-f17916ddc806"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-55f45afc-99b2-4d8d-9207-824ca1bde700 req-d1e76edf-cb31-4acf-9331-487bf35557d9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-55f45afc-99b2-4d8d-9207-824ca1bde700 req-d1e76edf-cb31-4acf-9331-487bf35557d9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-55f45afc-99b2-4d8d-9207-824ca1bde700 req-d1e76edf-cb31-4acf-9331-487bf35557d9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-55f45afc-99b2-4d8d-9207-824ca1bde700 req-d1e76edf-cb31-4acf-9331-487bf35557d9 service nova] Creating event network-vif-unplugged:5b8574e2-f175-4432-a1cb-f17916ddc806 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-55f45afc-99b2-4d8d-9207-824ca1bde700 req-d1e76edf-cb31-4acf-9331-487bf35557d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165378 Apr 14 03:03:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 107/319] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:38 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-92123f34-488e-45bd-baad-fde5df967be5 req-5b43eaae-f88f-4451-ba4e-118ba26761ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "7e8d8948-ff3b-461a-921a-d90f46d9f84c"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-unplugged", "status": "completed", "tag": "04ec9de5-1982-4641-8e4f-6eed7f00cf51"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "04ec9de5-1982-4641-8e4f-6eed7f00cf51"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-unplugged", "status": "completed", "tag": "fa3f5b14-6337-4e66-b990-1ba1cb8ab667"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "fa3f5b14-6337-4e66-b990-1ba1cb8ab667"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-92123f34-488e-45bd-baad-fde5df967be5 req-5b43eaae-f88f-4451-ba4e-118ba26761ac service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-92123f34-488e-45bd-baad-fde5df967be5 req-5b43eaae-f88f-4451-ba4e-118ba26761ac service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-92123f34-488e-45bd-baad-fde5df967be5 req-5b43eaae-f88f-4451-ba4e-118ba26761ac service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-92123f34-488e-45bd-baad-fde5df967be5 req-5b43eaae-f88f-4451-ba4e-118ba26761ac service nova] Creating event network-vif-plugged:7e8d8948-ff3b-461a-921a-d90f46d9f84c for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-92123f34-488e-45bd-baad-fde5df967be5 req-5b43eaae-f88f-4451-ba4e-118ba26761ac service nova] Creating event network-vif-unplugged:04ec9de5-1982-4641-8e4f-6eed7f00cf51 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-92123f34-488e-45bd-baad-fde5df967be5 req-5b43eaae-f88f-4451-ba4e-118ba26761ac service nova] Creating event network-vif-plugged:04ec9de5-1982-4641-8e4f-6eed7f00cf51 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-92123f34-488e-45bd-baad-fde5df967be5 req-5b43eaae-f88f-4451-ba4e-118ba26761ac service nova] Creating event network-vif-unplugged:fa3f5b14-6337-4e66-b990-1ba1cb8ab667 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-92123f34-488e-45bd-baad-fde5df967be5 req-5b43eaae-f88f-4451-ba4e-118ba26761ac service nova] Creating event network-vif-plugged:fa3f5b14-6337-4e66-b990-1ba1cb8ab667 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-92123f34-488e-45bd-baad-fde5df967be5 req-5b43eaae-f88f-4451-ba4e-118ba26761ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.034477 Apr 14 03:03:38 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 106/320] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:38 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "5b8574e2-f175-4432-a1cb-f17916ddc806"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-unplugged", "status": "completed", "tag": "3e1675a7-2e92-4b45-a657-f7b811975097"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "3e1675a7-2e92-4b45-a657-f7b811975097"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-unplugged", "status": "completed", "tag": "e99be0b2-4a16-49d7-95ed-51790df3da10"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "e99be0b2-4a16-49d7-95ed-51790df3da10"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-unplugged", "status": "completed", "tag": "65202a6a-2d5f-420b-a2bb-02ad01831633"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-plugged", "status": "completed", "tag": "65202a6a-2d5f-420b-a2bb-02ad01831633"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Creating event network-vif-plugged:5b8574e2-f175-4432-a1cb-f17916ddc806 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Creating event network-vif-unplugged:3e1675a7-2e92-4b45-a657-f7b811975097 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Creating event network-vif-plugged:3e1675a7-2e92-4b45-a657-f7b811975097 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Creating event network-vif-unplugged:e99be0b2-4a16-49d7-95ed-51790df3da10 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Creating event network-vif-plugged:e99be0b2-4a16-49d7-95ed-51790df3da10 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Creating event network-vif-unplugged:65202a6a-2d5f-420b-a2bb-02ad01831633 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] Creating event network-vif-plugged:65202a6a-2d5f-420b-a2bb-02ad01831633 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-26b9c8d5-a8bf-4fd4-87e8-2adc192a0526 req-523ff724-8fb5-418d-a110-e23463eed529 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.038781 Apr 14 03:03:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 108/321] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 03:03:38 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:03:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b0001b2f-4592-42ca-a37e-95eb3b6040bb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b0001b2f-4592-42ca-a37e-95eb3b6040bb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0001b2f-4592-42ca-a37e-95eb3b6040bb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0001b2f-4592-42ca-a37e-95eb3b6040bb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0001b2f-4592-42ca-a37e-95eb3b6040bb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0001b2f-4592-42ca-a37e-95eb3b6040bb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0001b2f-4592-42ca-a37e-95eb3b6040bb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0001b2f-4592-42ca-a37e-95eb3b6040bb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:39 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-b0001b2f-4592-42ca-a37e-95eb3b6040bb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lazy-loading 'services' on Instance uuid bbb6cd58-ce7a-43ae-876d-51a888193f60 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:03:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b0001b2f-4592-42ca-a37e-95eb3b6040bb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/os-volume_attachments/d1ac2d2b-c18f-4958-a86e-fa298a15c9b8" status: 202 len: 0 microversion: 2.1 time: 0.338808 Apr 14 03:03:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 108/322] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:03:39 2023] DELETE /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/os-volume_attachments/d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:03:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-70505435-ff35-42e7-9252-872ec295097f req-3d091397-9cc6-4952-baa4-c3cd1ae94095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-deleted", "tag": "7e8d8948-ff3b-461a-921a-d90f46d9f84c"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-70505435-ff35-42e7-9252-872ec295097f req-3d091397-9cc6-4952-baa4-c3cd1ae94095 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-70505435-ff35-42e7-9252-872ec295097f req-3d091397-9cc6-4952-baa4-c3cd1ae94095 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-70505435-ff35-42e7-9252-872ec295097f req-3d091397-9cc6-4952-baa4-c3cd1ae94095 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-70505435-ff35-42e7-9252-872ec295097f req-3d091397-9cc6-4952-baa4-c3cd1ae94095 service nova] Creating event network-vif-deleted:7e8d8948-ff3b-461a-921a-d90f46d9f84c for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-70505435-ff35-42e7-9252-872ec295097f req-3d091397-9cc6-4952-baa4-c3cd1ae94095 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029963 Apr 14 03:03:41 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 107/323] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1ea06b1e-7aef-4788-b220-323c6edba48e tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1ea06b1e-7aef-4788-b220-323c6edba48e tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1ea06b1e-7aef-4788-b220-323c6edba48e tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1ea06b1e-7aef-4788-b220-323c6edba48e tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1ea06b1e-7aef-4788-b220-323c6edba48e tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Going to try to stop instance {{(pid=61664) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 03:03:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1ea06b1e-7aef-4788-b220-323c6edba48e tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/action" status: 202 len: 0 microversion: 2.1 time: 0.084260 Apr 14 03:03:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 109/324] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:03:42 2023] POST /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:03:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-090441f8-212c-463e-85e0-abcda443592f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-090441f8-212c-463e-85e0-abcda443592f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-090441f8-212c-463e-85e0-abcda443592f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-090441f8-212c-463e-85e0-abcda443592f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-090441f8-212c-463e-85e0-abcda443592f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-090441f8-212c-463e-85e0-abcda443592f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-090441f8-212c-463e-85e0-abcda443592f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-090441f8-212c-463e-85e0-abcda443592f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:42 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-090441f8-212c-463e-85e0-abcda443592f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-090441f8-212c-463e-85e0-abcda443592f tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1665 microversion: 2.1 time: 0.218769 Apr 14 03:03:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 109/325] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:03:42 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1665 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:03:42 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-01a78ce5-dc66-4521-8132-993366d5af09 req-494159dd-22fa-4be5-9bfe-b1cfd26ebd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-unplugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-01a78ce5-dc66-4521-8132-993366d5af09 req-494159dd-22fa-4be5-9bfe-b1cfd26ebd18 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-01a78ce5-dc66-4521-8132-993366d5af09 req-494159dd-22fa-4be5-9bfe-b1cfd26ebd18 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-01a78ce5-dc66-4521-8132-993366d5af09 req-494159dd-22fa-4be5-9bfe-b1cfd26ebd18 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:42 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-01a78ce5-dc66-4521-8132-993366d5af09 req-494159dd-22fa-4be5-9bfe-b1cfd26ebd18 service nova] Creating event network-vif-unplugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:03:42 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-01a78ce5-dc66-4521-8132-993366d5af09 req-494159dd-22fa-4be5-9bfe-b1cfd26ebd18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031758 Apr 14 03:03:42 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 108/326] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a7f3ae17-94f2-44ac-b9ca-9c728d06dbfe req-ced40d0e-8db3-4eca-966b-c3b1770b92e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-deleted", "tag": "65202a6a-2d5f-420b-a2bb-02ad01831633"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-deleted", "tag": "e99be0b2-4a16-49d7-95ed-51790df3da10"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-deleted", "tag": "fa3f5b14-6337-4e66-b990-1ba1cb8ab667"}, {"server_uuid": "a78d15ea-7cb2-46e9-af86-8982e053d55a", "name": "network-vif-deleted", "tag": "04ec9de5-1982-4641-8e4f-6eed7f00cf51"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a7f3ae17-94f2-44ac-b9ca-9c728d06dbfe req-ced40d0e-8db3-4eca-966b-c3b1770b92e7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a7f3ae17-94f2-44ac-b9ca-9c728d06dbfe req-ced40d0e-8db3-4eca-966b-c3b1770b92e7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a7f3ae17-94f2-44ac-b9ca-9c728d06dbfe req-ced40d0e-8db3-4eca-966b-c3b1770b92e7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a7f3ae17-94f2-44ac-b9ca-9c728d06dbfe req-ced40d0e-8db3-4eca-966b-c3b1770b92e7 service nova] Creating event network-vif-deleted:65202a6a-2d5f-420b-a2bb-02ad01831633 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a7f3ae17-94f2-44ac-b9ca-9c728d06dbfe req-ced40d0e-8db3-4eca-966b-c3b1770b92e7 service nova] Creating event network-vif-deleted:e99be0b2-4a16-49d7-95ed-51790df3da10 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a7f3ae17-94f2-44ac-b9ca-9c728d06dbfe req-ced40d0e-8db3-4eca-966b-c3b1770b92e7 service nova] Creating event network-vif-deleted:fa3f5b14-6337-4e66-b990-1ba1cb8ab667 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a7f3ae17-94f2-44ac-b9ca-9c728d06dbfe req-ced40d0e-8db3-4eca-966b-c3b1770b92e7 service nova] Creating event network-vif-deleted:04ec9de5-1982-4641-8e4f-6eed7f00cf51 for instance a78d15ea-7cb2-46e9-af86-8982e053d55a on user Apr 14 03:03:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a7f3ae17-94f2-44ac-b9ca-9c728d06dbfe req-ced40d0e-8db3-4eca-966b-c3b1770b92e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.036765 Apr 14 03:03:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 110/327] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:43 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-1b13e9e8-3c38-4e2b-83a0-1db6c8f1304f req-ce90c1c8-2c53-476a-b457-197ada21ad13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1b13e9e8-3c38-4e2b-83a0-1db6c8f1304f req-ce90c1c8-2c53-476a-b457-197ada21ad13 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1b13e9e8-3c38-4e2b-83a0-1db6c8f1304f req-ce90c1c8-2c53-476a-b457-197ada21ad13 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1b13e9e8-3c38-4e2b-83a0-1db6c8f1304f req-ce90c1c8-2c53-476a-b457-197ada21ad13 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-1b13e9e8-3c38-4e2b-83a0-1db6c8f1304f req-ce90c1c8-2c53-476a-b457-197ada21ad13 service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:03:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-1b13e9e8-3c38-4e2b-83a0-1db6c8f1304f req-ce90c1c8-2c53-476a-b457-197ada21ad13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036142 Apr 14 03:03:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 110/328] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-8d5f944f-a0dd-4327-b8f6-19e3b0319891 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:46 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-8d5f944f-a0dd-4327-b8f6-19e3b0319891 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8d5f944f-a0dd-4327-b8f6-19e3b0319891 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8d5f944f-a0dd-4327-b8f6-19e3b0319891 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8d5f944f-a0dd-4327-b8f6-19e3b0319891 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8d5f944f-a0dd-4327-b8f6-19e3b0319891 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8d5f944f-a0dd-4327-b8f6-19e3b0319891 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8d5f944f-a0dd-4327-b8f6-19e3b0319891 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:46 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-8d5f944f-a0dd-4327-b8f6-19e3b0319891 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-8d5f944f-a0dd-4327-b8f6-19e3b0319891 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1721 microversion: 2.1 time: 0.453751 Apr 14 03:03:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 109/329] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:03:46 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1721 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:03:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1c63edf6-57bc-4298-aaf0-8c746957df9d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:46 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1c63edf6-57bc-4298-aaf0-8c746957df9d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1c63edf6-57bc-4298-aaf0-8c746957df9d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1c63edf6-57bc-4298-aaf0-8c746957df9d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1c63edf6-57bc-4298-aaf0-8c746957df9d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1c63edf6-57bc-4298-aaf0-8c746957df9d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1c63edf6-57bc-4298-aaf0-8c746957df9d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1c63edf6-57bc-4298-aaf0-8c746957df9d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9333bc75-7341-410d-897e-60df6d436ea4 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:46 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-9333bc75-7341-410d-897e-60df6d436ea4 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9333bc75-7341-410d-897e-60df6d436ea4 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9333bc75-7341-410d-897e-60df6d436ea4 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9333bc75-7341-410d-897e-60df6d436ea4 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9333bc75-7341-410d-897e-60df6d436ea4 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9333bc75-7341-410d-897e-60df6d436ea4 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9333bc75-7341-410d-897e-60df6d436ea4 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:46 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-1c63edf6-57bc-4298-aaf0-8c746957df9d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:03:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1c63edf6-57bc-4298-aaf0-8c746957df9d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1721 microversion: 2.1 time: 0.189125 Apr 14 03:03:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 111/330] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:03:46 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:03:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9333bc75-7341-410d-897e-60df6d436ea4 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091665 Apr 14 03:03:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 111/331] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:03:46 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:47 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-174cd578-2ca3-41d3-81ac-e4332a3f4814 req-9d02ea7e-e8df-4b0c-8cb0-ad319ef01ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49", "tag": "b975970e-4ce0-4b1c-b1b3-956befa892e0"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-174cd578-2ca3-41d3-81ac-e4332a3f4814 req-9d02ea7e-e8df-4b0c-8cb0-ad319ef01ceb service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-174cd578-2ca3-41d3-81ac-e4332a3f4814 req-9d02ea7e-e8df-4b0c-8cb0-ad319ef01ceb service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-174cd578-2ca3-41d3-81ac-e4332a3f4814 req-9d02ea7e-e8df-4b0c-8cb0-ad319ef01ceb service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:47 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-174cd578-2ca3-41d3-81ac-e4332a3f4814 req-9d02ea7e-e8df-4b0c-8cb0-ad319ef01ceb service nova] Creating event network-changed:b975970e-4ce0-4b1c-b1b3-956befa892e0 for instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 on user Apr 14 03:03:47 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-174cd578-2ca3-41d3-81ac-e4332a3f4814 req-9d02ea7e-e8df-4b0c-8cb0-ad319ef01ceb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028222 Apr 14 03:03:47 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 110/332] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:03:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b67cc212-2026-4f04-8ae8-c311818e9eb9 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0032d61d-2851-4bde-b7cd-42043f3b1a7f"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:47 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b67cc212-2026-4f04-8ae8-c311818e9eb9 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b67cc212-2026-4f04-8ae8-c311818e9eb9 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b67cc212-2026-4f04-8ae8-c311818e9eb9 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b67cc212-2026-4f04-8ae8-c311818e9eb9 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b67cc212-2026-4f04-8ae8-c311818e9eb9 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b67cc212-2026-4f04-8ae8-c311818e9eb9 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b67cc212-2026-4f04-8ae8-c311818e9eb9 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b67cc212-2026-4f04-8ae8-c311818e9eb9 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298144 Apr 14 03:03:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 112/333] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:03:47 2023] POST /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:03:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-88a3c668-9f74-4a4d-8655-a29086dfa3cd tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "80d66b06-08ad-4e2d-b0b7-5906492cd660"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:03:54 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-88a3c668-9f74-4a4d-8655-a29086dfa3cd tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-88a3c668-9f74-4a4d-8655-a29086dfa3cd tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-88a3c668-9f74-4a4d-8655-a29086dfa3cd tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-88a3c668-9f74-4a4d-8655-a29086dfa3cd tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-88a3c668-9f74-4a4d-8655-a29086dfa3cd tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-88a3c668-9f74-4a4d-8655-a29086dfa3cd tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-88a3c668-9f74-4a4d-8655-a29086dfa3cd tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-88a3c668-9f74-4a4d-8655-a29086dfa3cd tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments/0032d61d-2851-4bde-b7cd-42043f3b1a7f" status: 202 len: 0 microversion: 2.1 time: 0.455317 Apr 14 03:03:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 112/334] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 03:03:54 2023] PUT /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments/0032d61d-2851-4bde-b7cd-42043f3b1a7f => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:03:57 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:03:57 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 287a236d-d191-465f-bb65-636732ce5689] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:03:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:03:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:03:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:03:57 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] HTTP exception thrown: Instance 287a236d-d191-465f-bb65-636732ce5689 could not be found. Apr 14 03:03:57 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Request method failure captured: Apr 14 03:03:57 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689 HTTP/1.1 Apr 14 03:03:57 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:03:57 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:03:57 user devstack@n-api.service[61662]: Connection: close Apr 14 03:03:57 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:03:57 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:03:57 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:03:57 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:03:57 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEqMSR-uxmC1QwauJm2dkBn3lFpJlEgE_LLRxwC9KNMAOsVfHjeItOJTrMhBtfrru92-geHUfWoQL5YrxL7z_wPJdv4SJXdlzmWY67rnYfpEU_crfrSYBPZx7OinZppYNZnj5_Z9x0VyBOkEjkw8wd3pyfwKmjFZBKZxExGMVTkSrw Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Project-Id: 94a1eb61159b43228db0d529a5be816d Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Project-Name: tempest-VolumesAdminNegativeTest-1232189050 Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94a1eb61159b43228db0d529a5be816d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94a1eb61159b43228db0d529a5be816d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94a1eb61159b43228db0d529a5be816d"}]}] Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Tenant: tempest-VolumesAdminNegativeTest-1232189050 Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Tenant-Id: 94a1eb61159b43228db0d529a5be816d Apr 14 03:03:57 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1232189050 Apr 14 03:03:57 user devstack@n-api.service[61662]: X-User: tempest-VolumesAdminNegativeTest-1232189050-project-member Apr 14 03:03:57 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:03:57 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:03:57 user devstack@n-api.service[61662]: X-User-Id: f0d4916eb93c4b3ebbbd2af4b0cdacc1 Apr 14 03:03:57 user devstack@n-api.service[61662]: X-User-Name: tempest-VolumesAdminNegativeTest-1232189050-project-member Apr 14 03:03:57 user devstack@n-api.service[61662]: method: > Apr 14 03:03:57 user devstack@n-api.service[61662]: exception: Instance 287a236d-d191-465f-bb65-636732ce5689 could not be found. Apr 14 03:03:57 user devstack@n-api.service[61662]: action_args: {'id': '287a236d-d191-465f-bb65-636732ce5689'} Apr 14 03:03:57 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287a236d-d191-465f-bb65-636732ce5689 could not be found. Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287a236d-d191-465f-bb65-636732ce5689 could not be found. Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287a236d-d191-465f-bb65-636732ce5689 could not be found. Apr 14 03:03:57 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:03:57 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Returning 404 to user: Instance 287a236d-d191-465f-bb65-636732ce5689 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:03:57 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3dc583e4-a057-4940-9556-6afa1f3203f0 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689" status: 404 len: 111 microversion: 2.1 time: 0.052250 Apr 14 03:03:57 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 111/335] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:03:57 2023] GET /compute/v2.1/servers/287a236d-d191-465f-bb65-636732ce5689 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=16 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-194eb9be-e29b-409c-b59d-7c63e8001d95 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-194eb9be-e29b-409c-b59d-7c63e8001d95 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-194eb9be-e29b-409c-b59d-7c63e8001d95 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-194eb9be-e29b-409c-b59d-7c63e8001d95 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-194eb9be-e29b-409c-b59d-7c63e8001d95 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-194eb9be-e29b-409c-b59d-7c63e8001d95 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-194eb9be-e29b-409c-b59d-7c63e8001d95 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-194eb9be-e29b-409c-b59d-7c63e8001d95 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:00 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-194eb9be-e29b-409c-b59d-7c63e8001d95 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:04:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-194eb9be-e29b-409c-b59d-7c63e8001d95 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5" status: 204 len: 0 microversion: 2.1 time: 0.137915 Apr 14 03:04:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 113/336] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:04:00 2023] DELETE /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:04:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-75f6131c-55b9-4851-bdd1-2a812ebd2701 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:00 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-75f6131c-55b9-4851-bdd1-2a812ebd2701 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-75f6131c-55b9-4851-bdd1-2a812ebd2701 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-75f6131c-55b9-4851-bdd1-2a812ebd2701 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-75f6131c-55b9-4851-bdd1-2a812ebd2701 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-75f6131c-55b9-4851-bdd1-2a812ebd2701 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-75f6131c-55b9-4851-bdd1-2a812ebd2701 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-75f6131c-55b9-4851-bdd1-2a812ebd2701 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:00 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-75f6131c-55b9-4851-bdd1-2a812ebd2701 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d4916eb93c4b3ebbbd2af4b0cdacc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a1eb61159b43228db0d529a5be816d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:04:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-75f6131c-55b9-4851-bdd1-2a812ebd2701 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5" status: 200 len: 1670 microversion: 2.1 time: 0.188079 Apr 14 03:04:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 113/337] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:04:00 2023] GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 => generated 1670 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:04:00 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-1ef518eb-3bbc-47f7-9689-28e14a245828 req-1a71a0d4-9820-42a9-bde6-f703c4edf317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5", "name": "network-vif-unplugged", "status": "completed", "tag": "9a41964d-ca86-41d7-8287-1af6e94403b4"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1ef518eb-3bbc-47f7-9689-28e14a245828 req-1a71a0d4-9820-42a9-bde6-f703c4edf317 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1ef518eb-3bbc-47f7-9689-28e14a245828 req-1a71a0d4-9820-42a9-bde6-f703c4edf317 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1ef518eb-3bbc-47f7-9689-28e14a245828 req-1a71a0d4-9820-42a9-bde6-f703c4edf317 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:00 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-1ef518eb-3bbc-47f7-9689-28e14a245828 req-1a71a0d4-9820-42a9-bde6-f703c4edf317 service nova] Creating event network-vif-unplugged:9a41964d-ca86-41d7-8287-1af6e94403b4 for instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 on user Apr 14 03:04:00 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-1ef518eb-3bbc-47f7-9689-28e14a245828 req-1a71a0d4-9820-42a9-bde6-f703c4edf317 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043343 Apr 14 03:04:00 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 112/338] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:04:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:02 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-336fcf56-2cef-4204-a51b-0276fb3dad37 req-dba3ea7b-9042-4d42-b864-78180c5a50c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5", "name": "network-vif-plugged", "status": "completed", "tag": "9a41964d-ca86-41d7-8287-1af6e94403b4"}, {"server_uuid": "3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5", "name": "network-vif-deleted", "tag": "9a41964d-ca86-41d7-8287-1af6e94403b4"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-336fcf56-2cef-4204-a51b-0276fb3dad37 req-dba3ea7b-9042-4d42-b864-78180c5a50c8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-336fcf56-2cef-4204-a51b-0276fb3dad37 req-dba3ea7b-9042-4d42-b864-78180c5a50c8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-336fcf56-2cef-4204-a51b-0276fb3dad37 req-dba3ea7b-9042-4d42-b864-78180c5a50c8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-336fcf56-2cef-4204-a51b-0276fb3dad37 req-dba3ea7b-9042-4d42-b864-78180c5a50c8 service nova] Creating event network-vif-plugged:9a41964d-ca86-41d7-8287-1af6e94403b4 for instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 on user Apr 14 03:04:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-336fcf56-2cef-4204-a51b-0276fb3dad37 req-dba3ea7b-9042-4d42-b864-78180c5a50c8 service nova] Creating event network-vif-deleted:9a41964d-ca86-41d7-8287-1af6e94403b4 for instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 on user Apr 14 03:04:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-336fcf56-2cef-4204-a51b-0276fb3dad37 req-dba3ea7b-9042-4d42-b864-78180c5a50c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039360 Apr 14 03:04:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 114/339] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:04:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-07563f37-65c5-4249-bbf7-a436bd1397a8 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:07 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-07563f37-65c5-4249-bbf7-a436bd1397a8 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-07563f37-65c5-4249-bbf7-a436bd1397a8 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-07563f37-65c5-4249-bbf7-a436bd1397a8 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-07563f37-65c5-4249-bbf7-a436bd1397a8 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-07563f37-65c5-4249-bbf7-a436bd1397a8 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-07563f37-65c5-4249-bbf7-a436bd1397a8 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-07563f37-65c5-4249-bbf7-a436bd1397a8 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-07563f37-65c5-4249-bbf7-a436bd1397a8 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050670 Apr 14 03:04:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 114/340] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:04:07 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:07 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f29532f5-ba25-49e6-ad02-606b8670ce7c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:07 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-f29532f5-ba25-49e6-ad02-606b8670ce7c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:07 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=23 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f29532f5-ba25-49e6-ad02-606b8670ce7c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f29532f5-ba25-49e6-ad02-606b8670ce7c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f29532f5-ba25-49e6-ad02-606b8670ce7c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f29532f5-ba25-49e6-ad02-606b8670ce7c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f29532f5-ba25-49e6-ad02-606b8670ce7c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f29532f5-ba25-49e6-ad02-606b8670ce7c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:07 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=35 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:07 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f29532f5-ba25-49e6-ad02-606b8670ce7c tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044401 Apr 14 03:04:07 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 113/341] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:04:07 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-52fc5624-5b30-4fef-bd2d-fff64eca21ec tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0032d61d-2851-4bde-b7cd-42043f3b1a7f"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:07 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-52fc5624-5b30-4fef-bd2d-fff64eca21ec tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52fc5624-5b30-4fef-bd2d-fff64eca21ec tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52fc5624-5b30-4fef-bd2d-fff64eca21ec tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52fc5624-5b30-4fef-bd2d-fff64eca21ec tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52fc5624-5b30-4fef-bd2d-fff64eca21ec tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52fc5624-5b30-4fef-bd2d-fff64eca21ec tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52fc5624-5b30-4fef-bd2d-fff64eca21ec tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-52fc5624-5b30-4fef-bd2d-fff64eca21ec tempest-TestVolumeSwap-1976683534 tempest-TestVolumeSwap-1976683534-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments/80d66b06-08ad-4e2d-b0b7-5906492cd660" status: 202 len: 0 microversion: 2.1 time: 0.307194 Apr 14 03:04:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 115/342] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 03:04:07 2023] PUT /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments/80d66b06-08ad-4e2d-b0b7-5906492cd660 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d201be56-e2cb-419d-a4a9-857b89c6620b tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d201be56-e2cb-419d-a4a9-857b89c6620b tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=5 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d201be56-e2cb-419d-a4a9-857b89c6620b tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d201be56-e2cb-419d-a4a9-857b89c6620b tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d201be56-e2cb-419d-a4a9-857b89c6620b tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d201be56-e2cb-419d-a4a9-857b89c6620b tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d201be56-e2cb-419d-a4a9-857b89c6620b tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d201be56-e2cb-419d-a4a9-857b89c6620b tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d201be56-e2cb-419d-a4a9-857b89c6620b tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046883 Apr 14 03:04:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 115/343] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:04:19 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:19 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:19 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=5 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:19 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-dfbdbb3e-d382-43a6-a416-a9738f63ea06 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:19 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-dfbdbb3e-d382-43a6-a416-a9738f63ea06 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb3e-d382-43a6-a416-a9738f63ea06 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb3e-d382-43a6-a416-a9738f63ea06 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb3e-d382-43a6-a416-a9738f63ea06 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb3e-d382-43a6-a416-a9738f63ea06 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb3e-d382-43a6-a416-a9738f63ea06 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb3e-d382-43a6-a416-a9738f63ea06 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:19 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-dfbdbb3e-d382-43a6-a416-a9738f63ea06 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045938 Apr 14 03:04:19 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 114/344] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:04:19 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a0f0a80d-f60f-4875-96f0-6f7b68070488 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a0f0a80d-f60f-4875-96f0-6f7b68070488 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a0f0a80d-f60f-4875-96f0-6f7b68070488 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a0f0a80d-f60f-4875-96f0-6f7b68070488 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a0f0a80d-f60f-4875-96f0-6f7b68070488 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a0f0a80d-f60f-4875-96f0-6f7b68070488 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a0f0a80d-f60f-4875-96f0-6f7b68070488 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a0f0a80d-f60f-4875-96f0-6f7b68070488 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:19 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-a0f0a80d-f60f-4875-96f0-6f7b68070488 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lazy-loading 'services' on Instance uuid b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:04:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a0f0a80d-f60f-4875-96f0-6f7b68070488 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments/0032d61d-2851-4bde-b7cd-42043f3b1a7f" status: 202 len: 0 microversion: 2.1 time: 0.165415 Apr 14 03:04:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 116/345] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:04:19 2023] DELETE /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments/0032d61d-2851-4bde-b7cd-42043f3b1a7f => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d047d45a-327d-40e7-bf63-594dbe9a6a1a tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d047d45a-327d-40e7-bf63-594dbe9a6a1a tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d047d45a-327d-40e7-bf63-594dbe9a6a1a tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d047d45a-327d-40e7-bf63-594dbe9a6a1a tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d047d45a-327d-40e7-bf63-594dbe9a6a1a tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d047d45a-327d-40e7-bf63-594dbe9a6a1a tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d047d45a-327d-40e7-bf63-594dbe9a6a1a tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d047d45a-327d-40e7-bf63-594dbe9a6a1a tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d047d45a-327d-40e7-bf63-594dbe9a6a1a tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049069 Apr 14 03:04:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 116/346] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:04:19 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:20 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-af053bea-a319-4c30-9729-4ab56da1d613 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:20 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-af053bea-a319-4c30-9729-4ab56da1d613 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-af053bea-a319-4c30-9729-4ab56da1d613 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-af053bea-a319-4c30-9729-4ab56da1d613 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-af053bea-a319-4c30-9729-4ab56da1d613 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-af053bea-a319-4c30-9729-4ab56da1d613 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-af053bea-a319-4c30-9729-4ab56da1d613 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-af053bea-a319-4c30-9729-4ab56da1d613 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:20 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-af053bea-a319-4c30-9729-4ab56da1d613 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:04:20 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-af053bea-a319-4c30-9729-4ab56da1d613 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef" status: 200 len: 1394 microversion: 2.1 time: 0.407717 Apr 14 03:04:20 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 115/347] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:04:19 2023] GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef => generated 1394 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:04:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-559111257"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:20 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:20 user devstack@n-api.service[61664]: INFO nova.compute.api [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Attempting to quiesce instance before volume snapshot. Apr 14 03:04:20 user devstack@n-api.service[61664]: INFO nova.compute.api [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 03:04:20 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Creating snapshot from volume 37bd0d93-b922-426c-8986-d86e886da69e. {{(pid=61664) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 03:04:22 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1cd0c716-7f5b-4640-a07a-79cb7592e811 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:22 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1cd0c716-7f5b-4640-a07a-79cb7592e811 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1cd0c716-7f5b-4640-a07a-79cb7592e811 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1cd0c716-7f5b-4640-a07a-79cb7592e811 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1cd0c716-7f5b-4640-a07a-79cb7592e811 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1cd0c716-7f5b-4640-a07a-79cb7592e811 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1cd0c716-7f5b-4640-a07a-79cb7592e811 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1cd0c716-7f5b-4640-a07a-79cb7592e811 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:22 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-1cd0c716-7f5b-4640-a07a-79cb7592e811 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337e2d8118324215b5a0baa36a5895b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6371b4c05df843da9b134e12994c1d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:04:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1cd0c716-7f5b-4640-a07a-79cb7592e811 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d" status: 200 len: 1536 microversion: 2.1 time: 0.199450 Apr 14 03:04:22 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 117/348] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:04:22 2023] GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d => generated 1536 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:04:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef/action" status: 202 len: 0 microversion: 2.1 time: 2.518550 Apr 14 03:04:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 117/349] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:04:20 2023] POST /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef/action => generated 0 bytes in 2521 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-380447828", "imageRef": "b58349d2-f4ea-42ed-81b9-5113fd237947", "flavorRef": "42", "networks": [{"uuid": "ea0f3bca-5794-46e4-a270-53dbe99375bd"}]}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] validate_networks() for [('ea0f3bca-5794-46e4-a270-53dbe99375bd', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for user 60e11b7ab2914209b23bf7a53791da64 and project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:04:23 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 62cad020-0344-4e4e-add9-e5bc6175adbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f78b3968-f436-44d2-8fb3-4f3d899eeed5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:04:23 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.624838 Apr 14 03:04:23 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 116/350] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:04:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:04:23 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b0776d87-3d38-4ae4-a201-bba3be9de9d5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:23 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b0776d87-3d38-4ae4-a201-bba3be9de9d5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 62cad020-0344-4e4e-add9-e5bc6175adbb] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:23 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-b0776d87-3d38-4ae4-a201-bba3be9de9d5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:04:23 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b0776d87-3d38-4ae4-a201-bba3be9de9d5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb" status: 200 len: 1223 microversion: 2.1 time: 0.075078 Apr 14 03:04:23 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 118/351] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:04:23 2023] GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb => generated 1223 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:04:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-c6b74c45-9f87-4c14-beb0-a19b6da85496 req-892a22f2-501c-4ef9-843e-6d74aa5b77d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8c2e40-f896-4d21-9927-67330485d77d", "tag": "a36f717a-9a8b-43c9-ba01-0f03a522d166"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c6b74c45-9f87-4c14-beb0-a19b6da85496 req-892a22f2-501c-4ef9-843e-6d74aa5b77d5 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c6b74c45-9f87-4c14-beb0-a19b6da85496 req-892a22f2-501c-4ef9-843e-6d74aa5b77d5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c6b74c45-9f87-4c14-beb0-a19b6da85496 req-892a22f2-501c-4ef9-843e-6d74aa5b77d5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c6b74c45-9f87-4c14-beb0-a19b6da85496 req-892a22f2-501c-4ef9-843e-6d74aa5b77d5 service nova] Creating event network-changed:a36f717a-9a8b-43c9-ba01-0f03a522d166 for instance dc8c2e40-f896-4d21-9927-67330485d77d on user Apr 14 03:04:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-c6b74c45-9f87-4c14-beb0-a19b6da85496 req-892a22f2-501c-4ef9-843e-6d74aa5b77d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034425 Apr 14 03:04:25 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 118/352] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:04:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:25 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95596aa7-5fd3-48b5-a091-0379a2e77fcc"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:25 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-63d79061-5654-41b9-b570-2855cac51848 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:25 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-63d79061-5654-41b9-b570-2855cac51848 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-63d79061-5654-41b9-b570-2855cac51848 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-63d79061-5654-41b9-b570-2855cac51848 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-63d79061-5654-41b9-b570-2855cac51848 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-63d79061-5654-41b9-b570-2855cac51848 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-63d79061-5654-41b9-b570-2855cac51848 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-63d79061-5654-41b9-b570-2855cac51848 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:25 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285673 Apr 14 03:04:25 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 117/353] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:04:25 2023] POST /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:25 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-63d79061-5654-41b9-b570-2855cac51848 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbce21e767a4a61b9213e38523d247e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021342634dd4f16bf2720533070154c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:04:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-63d79061-5654-41b9-b570-2855cac51848 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b" status: 200 len: 1493 microversion: 2.1 time: 0.336990 Apr 14 03:04:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 119/354] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:04:25 2023] GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b => generated 1493 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:04:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-c391dbb9-5725-4e6e-b0dc-e8458954ffab req-594ec0ec-7720-497e-9482-6b5d68c98d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62cad020-0344-4e4e-add9-e5bc6175adbb", "tag": "a07f6861-f9f6-42c0-8d36-07db58ad1cb2"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c391dbb9-5725-4e6e-b0dc-e8458954ffab req-594ec0ec-7720-497e-9482-6b5d68c98d92 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c391dbb9-5725-4e6e-b0dc-e8458954ffab req-594ec0ec-7720-497e-9482-6b5d68c98d92 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c391dbb9-5725-4e6e-b0dc-e8458954ffab req-594ec0ec-7720-497e-9482-6b5d68c98d92 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c391dbb9-5725-4e6e-b0dc-e8458954ffab req-594ec0ec-7720-497e-9482-6b5d68c98d92 service nova] Creating event network-changed:a07f6861-f9f6-42c0-8d36-07db58ad1cb2 for instance 62cad020-0344-4e4e-add9-e5bc6175adbb on user Apr 14 03:04:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-c391dbb9-5725-4e6e-b0dc-e8458954ffab req-594ec0ec-7720-497e-9482-6b5d68c98d92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032234 Apr 14 03:04:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:04:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:26 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:26 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] HTTP exception thrown: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:26 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Request method failure captured: Apr 14 03:04:26 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a HTTP/1.1 Apr 14 03:04:26 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:04:26 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:04:26 user devstack@n-api.service[61662]: Connection: close Apr 14 03:04:26 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:04:26 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:04:26 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:04:26 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:04:26 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMH4Wh9QCt2ovv8n1bZQtOXnp0qkhTRQYFerhSnFw_kaTb_iZGJCjVxoO-yznJFBosLO7Y6BoBdvwgwFUFzBefTPAlmnc7TM9GIpJwPJvYYe2JZB4qUrgf9UWTrjWRGG3gkOO2qKF97T2OkUOizOv5numghAIv0p_oJsVPiD6yBsOxc Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Project-Id: de2d10e0d7e7477484e4204841a3980c Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Project-Name: tempest-TaggedBootDevicesTest-226254012 Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/de2d10e0d7e7477484e4204841a3980c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/de2d10e0d7e7477484e4204841a3980c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/de2d10e0d7e7477484e4204841a3980c"}]}] Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Tenant: tempest-TaggedBootDevicesTest-226254012 Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Tenant-Id: de2d10e0d7e7477484e4204841a3980c Apr 14 03:04:26 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TaggedBootDevicesTest-226254012 Apr 14 03:04:26 user devstack@n-api.service[61662]: X-User: tempest-TaggedBootDevicesTest-226254012-project-member Apr 14 03:04:26 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:04:26 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:04:26 user devstack@n-api.service[61662]: X-User-Id: c3c342144e51496190e32329225ddd2b Apr 14 03:04:26 user devstack@n-api.service[61662]: X-User-Name: tempest-TaggedBootDevicesTest-226254012-project-member Apr 14 03:04:26 user devstack@n-api.service[61662]: method: > Apr 14 03:04:26 user devstack@n-api.service[61662]: exception: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:26 user devstack@n-api.service[61662]: action_args: {'id': 'a78d15ea-7cb2-46e9-af86-8982e053d55a'} Apr 14 03:04:26 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:26 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:04:26 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Returning 404 to user: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:04:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-65b0d4a1-633f-4acc-b776-3440877fcec7 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a" status: 404 len: 111 microversion: 2.32 time: 0.040926 Apr 14 03:04:26 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 118/356] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:04:26 2023] GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:04:26 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-fbe418db-c298-49af-8bb3-24a0805f182d tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '.version_select at 0x7ff11a4e3010>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-fbe418db-c298-49af-8bb3-24a0805f182d tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725553182" status: 204 len: 0 microversion: 2.32 time: 0.025760 Apr 14 03:04:26 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 120/357] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 03:04:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725553182 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:04:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:30 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] HTTP exception thrown: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Request method failure captured: Apr 14 03:04:30 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a HTTP/1.1 Apr 14 03:04:30 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:04:30 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:04:30 user devstack@n-api.service[61664]: Connection: close Apr 14 03:04:30 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:04:30 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:04:30 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:04:30 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:04:30 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMH4Wh9QCt2ovv8n1bZQtOXnp0qkhTRQYFerhSnFw_kaTb_iZGJCjVxoO-yznJFBosLO7Y6BoBdvwgwFUFzBefTPAlmnc7TM9GIpJwPJvYYe2JZB4qUrgf9UWTrjWRGG3gkOO2qKF97T2OkUOizOv5numghAIv0p_oJsVPiD6yBsOxc Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Project-Id: de2d10e0d7e7477484e4204841a3980c Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Project-Name: tempest-TaggedBootDevicesTest-226254012 Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/de2d10e0d7e7477484e4204841a3980c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/de2d10e0d7e7477484e4204841a3980c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/de2d10e0d7e7477484e4204841a3980c"}]}] Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Tenant: tempest-TaggedBootDevicesTest-226254012 Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Tenant-Id: de2d10e0d7e7477484e4204841a3980c Apr 14 03:04:30 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TaggedBootDevicesTest-226254012 Apr 14 03:04:30 user devstack@n-api.service[61664]: X-User: tempest-TaggedBootDevicesTest-226254012-project-member Apr 14 03:04:30 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:04:30 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:04:30 user devstack@n-api.service[61664]: X-User-Id: c3c342144e51496190e32329225ddd2b Apr 14 03:04:30 user devstack@n-api.service[61664]: X-User-Name: tempest-TaggedBootDevicesTest-226254012-project-member Apr 14 03:04:30 user devstack@n-api.service[61664]: method: > Apr 14 03:04:30 user devstack@n-api.service[61664]: exception: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:30 user devstack@n-api.service[61664]: action_args: {'id': 'a78d15ea-7cb2-46e9-af86-8982e053d55a'} Apr 14 03:04:30 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Returning 404 to user: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:04:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-83eb3fba-34c7-4e0d-9edf-a311197ff7d6 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a" status: 404 len: 111 microversion: 2.32 time: 0.029980 Apr 14 03:04:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 120/358] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:04:30 2023] DELETE /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:04:30 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:30 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] [instance: a78d15ea-7cb2-46e9-af86-8982e053d55a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:30 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] HTTP exception thrown: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:30 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Request method failure captured: Apr 14 03:04:30 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a HTTP/1.1 Apr 14 03:04:30 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:04:30 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:04:30 user devstack@n-api.service[61662]: Connection: close Apr 14 03:04:30 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:04:30 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:04:30 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:04:30 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:04:30 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMH4Wh9QCt2ovv8n1bZQtOXnp0qkhTRQYFerhSnFw_kaTb_iZGJCjVxoO-yznJFBosLO7Y6BoBdvwgwFUFzBefTPAlmnc7TM9GIpJwPJvYYe2JZB4qUrgf9UWTrjWRGG3gkOO2qKF97T2OkUOizOv5numghAIv0p_oJsVPiD6yBsOxc Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Project-Id: de2d10e0d7e7477484e4204841a3980c Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Project-Name: tempest-TaggedBootDevicesTest-226254012 Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/de2d10e0d7e7477484e4204841a3980c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/de2d10e0d7e7477484e4204841a3980c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/de2d10e0d7e7477484e4204841a3980c"}]}] Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Tenant: tempest-TaggedBootDevicesTest-226254012 Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Tenant-Id: de2d10e0d7e7477484e4204841a3980c Apr 14 03:04:30 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TaggedBootDevicesTest-226254012 Apr 14 03:04:30 user devstack@n-api.service[61662]: X-User: tempest-TaggedBootDevicesTest-226254012-project-member Apr 14 03:04:30 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:04:30 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:04:30 user devstack@n-api.service[61662]: X-User-Id: c3c342144e51496190e32329225ddd2b Apr 14 03:04:30 user devstack@n-api.service[61662]: X-User-Name: tempest-TaggedBootDevicesTest-226254012-project-member Apr 14 03:04:30 user devstack@n-api.service[61662]: method: > Apr 14 03:04:30 user devstack@n-api.service[61662]: exception: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:30 user devstack@n-api.service[61662]: action_args: {'id': 'a78d15ea-7cb2-46e9-af86-8982e053d55a'} Apr 14 03:04:30 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. Apr 14 03:04:30 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:04:30 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] Returning 404 to user: Instance a78d15ea-7cb2-46e9-af86-8982e053d55a could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:04:30 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a6cb7efb-35a3-40c7-a848-3a576aacb626 tempest-TaggedBootDevicesTest-226254012 tempest-TaggedBootDevicesTest-226254012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a" status: 404 len: 111 microversion: 2.32 time: 0.027135 Apr 14 03:04:30 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 119/359] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:04:30 2023] GET /compute/v2.1/servers/a78d15ea-7cb2-46e9-af86-8982e053d55a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:04:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f11f6a40-07dd-4da5-8402-569c0fd08deb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f11f6a40-07dd-4da5-8402-569c0fd08deb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f11f6a40-07dd-4da5-8402-569c0fd08deb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f11f6a40-07dd-4da5-8402-569c0fd08deb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f11f6a40-07dd-4da5-8402-569c0fd08deb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f11f6a40-07dd-4da5-8402-569c0fd08deb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f11f6a40-07dd-4da5-8402-569c0fd08deb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f11f6a40-07dd-4da5-8402-569c0fd08deb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:32 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-f11f6a40-07dd-4da5-8402-569c0fd08deb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:04:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f11f6a40-07dd-4da5-8402-569c0fd08deb tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1642 microversion: 2.1 time: 0.150659 Apr 14 03:04:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 121/360] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:04:32 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1642 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4f0f726-f20c-4b09-89f2-59415d36a8eb"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-70ceee7d-ed81-4567-995b-240deed754da tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-70ceee7d-ed81-4567-995b-240deed754da tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70ceee7d-ed81-4567-995b-240deed754da tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70ceee7d-ed81-4567-995b-240deed754da tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70ceee7d-ed81-4567-995b-240deed754da tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 while it is in vm_state rescued Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70ceee7d-ed81-4567-995b-240deed754da tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70ceee7d-ed81-4567-995b-240deed754da tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70ceee7d-ed81-4567-995b-240deed754da tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Request method failure captured: Apr 14 03:04:33 user devstack@n-api.service[61664]: request: POST /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6/os-volume_attachments HTTP/1.1 Apr 14 03:04:33 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:04:33 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:04:33 user devstack@n-api.service[61664]: Connection: close Apr 14 03:04:33 user devstack@n-api.service[61664]: Content-Length: 74 Apr 14 03:04:33 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:04:33 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:04:33 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:04:33 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEwmVtNRDetgWO5mTD1bEUocoJOj9YFGH40WwivXpN1Xs8gxlA0vVPe_uVHwCMswvqd9NviH5dTXLGC0t38Yu4iQwgvLzajFOxfBIuObMRSmhp1Wer7zSPZ6VE5STLyrn3LfTG0y7nuum9vJ4mym9BmUd-cBbpnhMSg3gviUoA8AKw Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Project-Id: 558bfd7e1d9049d396381de148b0c4a5 Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/558bfd7e1d9049d396381de148b0c4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/558bfd7e1d9049d396381de148b0c4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/558bfd7e1d9049d396381de148b0c4a5"}]}] Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Tenant-Id: 558bfd7e1d9049d396381de148b0c4a5 Apr 14 03:04:33 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:04:33 user devstack@n-api.service[61664]: X-User: tempest-ServerRescueNegativeTestJSON-773851452-project-member Apr 14 03:04:33 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:04:33 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:04:33 user devstack@n-api.service[61664]: X-User-Id: d5e8150f1502427fb3148f20354d212e Apr 14 03:04:33 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-773851452-project-member Apr 14 03:04:33 user devstack@n-api.service[61664]: Apr 14 03:04:33 user devstack@n-api.service[61664]: {"volumeAttachment": {"volumeId": "c4f0f726-f20c-4b09-89f2-59415d36a8eb"}} Apr 14 03:04:33 user devstack@n-api.service[61664]: method: > Apr 14 03:04:33 user devstack@n-api.service[61664]: exception: Cannot 'attach_volume' instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 while it is in vm_state rescued Apr 14 03:04:33 user devstack@n-api.service[61664]: action_args: {'server_id': '5e57cef1-b6cd-4291-a4c5-60e9dd22aed6', 'body': {'volumeAttachment': {'volumeId': 'c4f0f726-f20c-4b09-89f2-59415d36a8eb'}}} Apr 14 03:04:33 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 while it is in vm_state rescued Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 while it is in vm_state rescued Apr 14 03:04:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Returning 409 to user: Cannot 'attach_volume' instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 while it is in vm_state rescued {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:04:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b74a10b1-639d-4ab7-b60f-ca721df0c7b8 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067442 Apr 14 03:04:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 121/361] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:04:33 2023] POST /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-59db2d22-1c19-49c9-8259-ac89288f2720 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-59db2d22-1c19-49c9-8259-ac89288f2720 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-59db2d22-1c19-49c9-8259-ac89288f2720 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-59db2d22-1c19-49c9-8259-ac89288f2720 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-59db2d22-1c19-49c9-8259-ac89288f2720 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-59db2d22-1c19-49c9-8259-ac89288f2720 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-59db2d22-1c19-49c9-8259-ac89288f2720 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-59db2d22-1c19-49c9-8259-ac89288f2720 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:33 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-70ceee7d-ed81-4567-995b-240deed754da tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lazy-loading 'services' on Instance uuid dc8c2e40-f896-4d21-9927-67330485d77d {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:04:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-59db2d22-1c19-49c9-8259-ac89288f2720 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6/action" status: 202 len: 0 microversion: 2.1 time: 0.163184 Apr 14 03:04:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 122/362] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:04:33 2023] POST /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d7d3ef48-b99e-47c9-9ccf-02b784833dd1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d7d3ef48-b99e-47c9-9ccf-02b784833dd1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7d3ef48-b99e-47c9-9ccf-02b784833dd1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7d3ef48-b99e-47c9-9ccf-02b784833dd1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7d3ef48-b99e-47c9-9ccf-02b784833dd1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7d3ef48-b99e-47c9-9ccf-02b784833dd1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7d3ef48-b99e-47c9-9ccf-02b784833dd1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7d3ef48-b99e-47c9-9ccf-02b784833dd1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:33 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-70ceee7d-ed81-4567-995b-240deed754da tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d/os-volume_attachments/95596aa7-5fd3-48b5-a091-0379a2e77fcc" status: 202 len: 0 microversion: 2.1 time: 0.302984 Apr 14 03:04:33 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 120/363] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:04:33 2023] DELETE /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d/os-volume_attachments/95596aa7-5fd3-48b5-a091-0379a2e77fcc => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-81362f53-7e0d-4ef7-8014-2497cebcac1e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-81362f53-7e0d-4ef7-8014-2497cebcac1e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-81362f53-7e0d-4ef7-8014-2497cebcac1e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-81362f53-7e0d-4ef7-8014-2497cebcac1e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-81362f53-7e0d-4ef7-8014-2497cebcac1e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-81362f53-7e0d-4ef7-8014-2497cebcac1e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-81362f53-7e0d-4ef7-8014-2497cebcac1e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-81362f53-7e0d-4ef7-8014-2497cebcac1e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-81362f53-7e0d-4ef7-8014-2497cebcac1e tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122280 Apr 14 03:04:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 123/364] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:04:33 2023] GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:04:34 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-d7d3ef48-b99e-47c9-9ccf-02b784833dd1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:04:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d7d3ef48-b99e-47c9-9ccf-02b784833dd1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6" status: 200 len: 1497 microversion: 2.1 time: 0.436327 Apr 14 03:04:34 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 122/365] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:04:33 2023] GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 => generated 1497 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:04:35 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-194af282-d87a-483a-98a0-d0452ece7b4c req-809f0fd6-d6b4-420c-b6fb-401d08744a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-unplugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-194af282-d87a-483a-98a0-d0452ece7b4c req-809f0fd6-d6b4-420c-b6fb-401d08744a0a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-194af282-d87a-483a-98a0-d0452ece7b4c req-809f0fd6-d6b4-420c-b6fb-401d08744a0a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-194af282-d87a-483a-98a0-d0452ece7b4c req-809f0fd6-d6b4-420c-b6fb-401d08744a0a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-194af282-d87a-483a-98a0-d0452ece7b4c req-809f0fd6-d6b4-420c-b6fb-401d08744a0a service nova] Creating event network-vif-unplugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:04:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-194af282-d87a-483a-98a0-d0452ece7b4c req-809f0fd6-d6b4-420c-b6fb-401d08744a0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042620 Apr 14 03:04:35 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 121/366] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:04:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-442d37f2-8598-45fc-9415-9b0b5a4ef21d req-1cddba32-e230-44b1-954a-ca5c9b141938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-442d37f2-8598-45fc-9415-9b0b5a4ef21d req-1cddba32-e230-44b1-954a-ca5c9b141938 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-442d37f2-8598-45fc-9415-9b0b5a4ef21d req-1cddba32-e230-44b1-954a-ca5c9b141938 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-442d37f2-8598-45fc-9415-9b0b5a4ef21d req-1cddba32-e230-44b1-954a-ca5c9b141938 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-442d37f2-8598-45fc-9415-9b0b5a4ef21d req-1cddba32-e230-44b1-954a-ca5c9b141938 service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:04:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-442d37f2-8598-45fc-9415-9b0b5a4ef21d req-1cddba32-e230-44b1-954a-ca5c9b141938 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042965 Apr 14 03:04:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 124/367] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:04:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b51adc45-830d-4b02-a6e1-8ba40fa46bed req-dcd234eb-1c6d-4135-85d8-f924c416480f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}, {"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}, {"server_uuid": "62cad020-0344-4e4e-add9-e5bc6175adbb", "name": "network-vif-plugged", "status": "completed", "tag": "a07f6861-f9f6-42c0-8d36-07db58ad1cb2"}, {"server_uuid": "62cad020-0344-4e4e-add9-e5bc6175adbb", "name": "network-vif-plugged", "status": "completed", "tag": "a07f6861-f9f6-42c0-8d36-07db58ad1cb2"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b51adc45-830d-4b02-a6e1-8ba40fa46bed req-dcd234eb-1c6d-4135-85d8-f924c416480f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b51adc45-830d-4b02-a6e1-8ba40fa46bed req-dcd234eb-1c6d-4135-85d8-f924c416480f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b51adc45-830d-4b02-a6e1-8ba40fa46bed req-dcd234eb-1c6d-4135-85d8-f924c416480f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b51adc45-830d-4b02-a6e1-8ba40fa46bed req-dcd234eb-1c6d-4135-85d8-f924c416480f service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:04:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b51adc45-830d-4b02-a6e1-8ba40fa46bed req-dcd234eb-1c6d-4135-85d8-f924c416480f service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:04:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b51adc45-830d-4b02-a6e1-8ba40fa46bed req-dcd234eb-1c6d-4135-85d8-f924c416480f service nova] Creating event network-vif-plugged:a07f6861-f9f6-42c0-8d36-07db58ad1cb2 for instance 62cad020-0344-4e4e-add9-e5bc6175adbb on user Apr 14 03:04:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b51adc45-830d-4b02-a6e1-8ba40fa46bed req-dcd234eb-1c6d-4135-85d8-f924c416480f service nova] Creating event network-vif-plugged:a07f6861-f9f6-42c0-8d36-07db58ad1cb2 for instance 62cad020-0344-4e4e-add9-e5bc6175adbb on user Apr 14 03:04:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b51adc45-830d-4b02-a6e1-8ba40fa46bed req-dcd234eb-1c6d-4135-85d8-f924c416480f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.044025 Apr 14 03:04:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 123/368] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:04:39 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:47 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lazy-loading 'services' on Instance uuid 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:04:47 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments/f0c626e1-cd60-46d3-b894-a000a5cb3811" status: 202 len: 0 microversion: 2.1 time: 0.187670 Apr 14 03:04:47 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 122/369] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:04:47 2023] DELETE /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments/f0c626e1-cd60-46d3-b894-a000a5cb3811 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:04:47 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7a2d29cf-8348-4ada-b2fc-10373a85b26b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:47 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7a2d29cf-8348-4ada-b2fc-10373a85b26b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2d29cf-8348-4ada-b2fc-10373a85b26b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2d29cf-8348-4ada-b2fc-10373a85b26b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2d29cf-8348-4ada-b2fc-10373a85b26b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2d29cf-8348-4ada-b2fc-10373a85b26b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2d29cf-8348-4ada-b2fc-10373a85b26b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2d29cf-8348-4ada-b2fc-10373a85b26b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7a2d29cf-8348-4ada-b2fc-10373a85b26b tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073025 Apr 14 03:04:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 125/370] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:04:47 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=16 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] [instance: 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] HTTP exception thrown: Instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 could not be found. Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Request method failure captured: Apr 14 03:04:50 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 HTTP/1.1 Apr 14 03:04:50 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:04:50 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:04:50 user devstack@n-api.service[61664]: Connection: close Apr 14 03:04:50 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:04:50 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:04:50 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:04:50 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:04:50 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEqMSR-uxmC1QwauJm2dkBn3lFpJlEgE_LLRxwC9KNMAOsVfHjeItOJTrMhBtfrru92-geHUfWoQL5YrxL7z_wPJdv4SJXdlzmWY67rnYfpEU_crfrSYBPZx7OinZppYNZnj5_Z9x0VyBOkEjkw8wd3pyfwKmjFZBKZxExGMVTkSrw Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Project-Id: 94a1eb61159b43228db0d529a5be816d Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesAdminNegativeTest-1232189050 Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94a1eb61159b43228db0d529a5be816d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94a1eb61159b43228db0d529a5be816d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94a1eb61159b43228db0d529a5be816d"}]}] Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesAdminNegativeTest-1232189050 Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Tenant-Id: 94a1eb61159b43228db0d529a5be816d Apr 14 03:04:50 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1232189050 Apr 14 03:04:50 user devstack@n-api.service[61664]: X-User: tempest-VolumesAdminNegativeTest-1232189050-project-member Apr 14 03:04:50 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:04:50 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:04:50 user devstack@n-api.service[61664]: X-User-Id: f0d4916eb93c4b3ebbbd2af4b0cdacc1 Apr 14 03:04:50 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesAdminNegativeTest-1232189050-project-member Apr 14 03:04:50 user devstack@n-api.service[61664]: method: > Apr 14 03:04:50 user devstack@n-api.service[61664]: exception: Instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 could not be found. Apr 14 03:04:50 user devstack@n-api.service[61664]: action_args: {'id': '3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5'} Apr 14 03:04:50 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 could not be found. Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 could not be found. Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 could not be found. Apr 14 03:04:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:04:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Returning 404 to user: Instance 3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:04:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2d1e7a81-62ff-415b-8fdf-afce9a3c9979 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5" status: 404 len: 111 microversion: 2.1 time: 0.036724 Apr 14 03:04:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 124/371] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:04:50 2023] GET /compute/v2.1/servers/3ae6f41c-d3f6-4c45-9317-64dc9c7a98a5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:04:50 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-dd083aa3-c8cd-4858-8732-ceb40a482429 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] Calling method '.version_select at 0x7ff11a5f5e10>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-dd083aa3-c8cd-4858-8732-ceb40a482429 tempest-VolumesAdminNegativeTest-1232189050 tempest-VolumesAdminNegativeTest-1232189050-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-309889138" status: 202 len: 0 microversion: 2.1 time: 0.031470 Apr 14 03:04:50 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 123/372] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 03:04:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-309889138 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:04:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-514488998", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "de8764bb-1ca4-4c30-8dee-bce850658327"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:04:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:57 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] validate_networks() for [('de8764bb-1ca4-4c30-8dee-bce850658327', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:04:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Getting quotas for project bd2c5b2aafaf4ca7bf62e988ac726658. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Getting quotas for user d666936eb0ee43a2ad9e17a12e6e273d and project bd2c5b2aafaf4ca7bf62e988ac726658. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:04:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:04:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-bcda52d9-9dc7-4c79-95f9-2689b5d2abd8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.100013 Apr 14 03:04:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 126/373] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 03:04:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 03:04:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-bb77b03f-c5b7-46b9-8259-a495ab9e6c00 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:04:58 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-bb77b03f-c5b7-46b9-8259-a495ab9e6c00 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:04:58 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-bb77b03f-c5b7-46b9-8259-a495ab9e6c00 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:04:58 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-bb77b03f-c5b7-46b9-8259-a495ab9e6c00 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:04:58 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-bb77b03f-c5b7-46b9-8259-a495ab9e6c00 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:04:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-bb77b03f-c5b7-46b9-8259-a495ab9e6c00 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e" status: 200 len: 1394 microversion: 2.87 time: 0.568649 Apr 14 03:04:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 125/374] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:04:58 2023] GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e => generated 1394 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:05:01 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:01 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:01 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-13fa6735-2db9-4dac-872a-b1bf3746b060 req-4ed684c9-0759-4586-a9e2-40cb7f62d153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e", "tag": "22f727c9-9207-46e6-a471-48de5bf03677"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-13fa6735-2db9-4dac-872a-b1bf3746b060 req-4ed684c9-0759-4586-a9e2-40cb7f62d153 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-13fa6735-2db9-4dac-872a-b1bf3746b060 req-4ed684c9-0759-4586-a9e2-40cb7f62d153 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-13fa6735-2db9-4dac-872a-b1bf3746b060 req-4ed684c9-0759-4586-a9e2-40cb7f62d153 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-13fa6735-2db9-4dac-872a-b1bf3746b060 req-4ed684c9-0759-4586-a9e2-40cb7f62d153 service nova] Creating event network-changed:22f727c9-9207-46e6-a471-48de5bf03677 for instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e on user Apr 14 03:05:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-13fa6735-2db9-4dac-872a-b1bf3746b060 req-4ed684c9-0759-4586-a9e2-40cb7f62d153 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033640 Apr 14 03:05:01 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 124/375] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-522ea051-a34f-444a-acba-fb3d21edfe59 req-6fcdac54-39de-499a-84e4-e1ed45043c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e", "name": "network-vif-plugged", "status": "completed", "tag": "22f727c9-9207-46e6-a471-48de5bf03677"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-522ea051-a34f-444a-acba-fb3d21edfe59 req-6fcdac54-39de-499a-84e4-e1ed45043c6a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-522ea051-a34f-444a-acba-fb3d21edfe59 req-6fcdac54-39de-499a-84e4-e1ed45043c6a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-522ea051-a34f-444a-acba-fb3d21edfe59 req-6fcdac54-39de-499a-84e4-e1ed45043c6a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-522ea051-a34f-444a-acba-fb3d21edfe59 req-6fcdac54-39de-499a-84e4-e1ed45043c6a service nova] Creating event network-vif-plugged:22f727c9-9207-46e6-a471-48de5bf03677 for instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e on user Apr 14 03:05:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-522ea051-a34f-444a-acba-fb3d21edfe59 req-6fcdac54-39de-499a-84e4-e1ed45043c6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034652 Apr 14 03:05:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 127/376] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:05 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a1bd443e-625e-44cd-88d4-c6b024adc147 req-d5b5f137-3570-4194-93a5-c84d878ae67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e", "name": "network-vif-plugged", "status": "completed", "tag": "22f727c9-9207-46e6-a471-48de5bf03677"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a1bd443e-625e-44cd-88d4-c6b024adc147 req-d5b5f137-3570-4194-93a5-c84d878ae67d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a1bd443e-625e-44cd-88d4-c6b024adc147 req-d5b5f137-3570-4194-93a5-c84d878ae67d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a1bd443e-625e-44cd-88d4-c6b024adc147 req-d5b5f137-3570-4194-93a5-c84d878ae67d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a1bd443e-625e-44cd-88d4-c6b024adc147 req-d5b5f137-3570-4194-93a5-c84d878ae67d service nova] Creating event network-vif-plugged:22f727c9-9207-46e6-a471-48de5bf03677 for instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e on user Apr 14 03:05:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a1bd443e-625e-44cd-88d4-c6b024adc147 req-d5b5f137-3570-4194-93a5-c84d878ae67d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076819 Apr 14 03:05:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 126/377] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:09 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-dfc0dedd-9edf-4846-8f6d-07bce0d4d072 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:09 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-dfc0dedd-9edf-4846-8f6d-07bce0d4d072 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfc0dedd-9edf-4846-8f6d-07bce0d4d072 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfc0dedd-9edf-4846-8f6d-07bce0d4d072 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfc0dedd-9edf-4846-8f6d-07bce0d4d072 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfc0dedd-9edf-4846-8f6d-07bce0d4d072 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfc0dedd-9edf-4846-8f6d-07bce0d4d072 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dfc0dedd-9edf-4846-8f6d-07bce0d4d072 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:09 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-dfc0dedd-9edf-4846-8f6d-07bce0d4d072 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052006 Apr 14 03:05:09 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 125/378] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:05:09 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-43397368-d806-4962-88a9-24f9e8d2b934 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-43397368-d806-4962-88a9-24f9e8d2b934 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-43397368-d806-4962-88a9-24f9e8d2b934 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-43397368-d806-4962-88a9-24f9e8d2b934 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-43397368-d806-4962-88a9-24f9e8d2b934 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-43397368-d806-4962-88a9-24f9e8d2b934 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-43397368-d806-4962-88a9-24f9e8d2b934 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-43397368-d806-4962-88a9-24f9e8d2b934 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:09 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-43397368-d806-4962-88a9-24f9e8d2b934 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:05:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-43397368-d806-4962-88a9-24f9e8d2b934 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49" status: 204 len: 0 microversion: 2.1 time: 0.135532 Apr 14 03:05:10 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 128/379] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:05:09 2023] DELETE /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:05:10 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:10 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4e1dfd20-fa2f-4dfa-a194-efb0fcf8740f tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:10 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4e1dfd20-fa2f-4dfa-a194-efb0fcf8740f tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd20-fa2f-4dfa-a194-efb0fcf8740f tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd20-fa2f-4dfa-a194-efb0fcf8740f tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd20-fa2f-4dfa-a194-efb0fcf8740f tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd20-fa2f-4dfa-a194-efb0fcf8740f tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd20-fa2f-4dfa-a194-efb0fcf8740f tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e1dfd20-fa2f-4dfa-a194-efb0fcf8740f tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:10 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-4e1dfd20-fa2f-4dfa-a194-efb0fcf8740f tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f089c5c093754f8082181a8fc1c002f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f987064bf0ed4a2fa8714064fe8b43c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4e1dfd20-fa2f-4dfa-a194-efb0fcf8740f tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49" status: 200 len: 1648 microversion: 2.1 time: 0.197850 Apr 14 03:05:10 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 127/380] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:05:10 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 => generated 1648 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:05:10 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-1c860dd8-0abd-4985-b8fa-f76633b5c99a req-0c7a39e5-9a95-4f44-9423-0fc42b1a53a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49", "name": "network-vif-unplugged", "status": "completed", "tag": "b975970e-4ce0-4b1c-b1b3-956befa892e0"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1c860dd8-0abd-4985-b8fa-f76633b5c99a req-0c7a39e5-9a95-4f44-9423-0fc42b1a53a1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1c860dd8-0abd-4985-b8fa-f76633b5c99a req-0c7a39e5-9a95-4f44-9423-0fc42b1a53a1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1c860dd8-0abd-4985-b8fa-f76633b5c99a req-0c7a39e5-9a95-4f44-9423-0fc42b1a53a1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-1c860dd8-0abd-4985-b8fa-f76633b5c99a req-0c7a39e5-9a95-4f44-9423-0fc42b1a53a1 service nova] Creating event network-vif-unplugged:b975970e-4ce0-4b1c-b1b3-956befa892e0 for instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 on user Apr 14 03:05:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-1c860dd8-0abd-4985-b8fa-f76633b5c99a req-0c7a39e5-9a95-4f44-9423-0fc42b1a53a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032058 Apr 14 03:05:10 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 126/381] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:11 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-31f8136f-df60-442a-afe2-c39280f71616 req-9f770dcf-9430-44c3-987c-96bea3ff2dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49", "name": "network-vif-deleted", "tag": "b975970e-4ce0-4b1c-b1b3-956befa892e0"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-31f8136f-df60-442a-afe2-c39280f71616 req-9f770dcf-9430-44c3-987c-96bea3ff2dfa service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-31f8136f-df60-442a-afe2-c39280f71616 req-9f770dcf-9430-44c3-987c-96bea3ff2dfa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-31f8136f-df60-442a-afe2-c39280f71616 req-9f770dcf-9430-44c3-987c-96bea3ff2dfa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:11 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-31f8136f-df60-442a-afe2-c39280f71616 req-9f770dcf-9430-44c3-987c-96bea3ff2dfa service nova] Creating event network-vif-deleted:b975970e-4ce0-4b1c-b1b3-956befa892e0 for instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 on user Apr 14 03:05:11 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-31f8136f-df60-442a-afe2-c39280f71616 req-9f770dcf-9430-44c3-987c-96bea3ff2dfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038729 Apr 14 03:05:11 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 129/382] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b88572a8-116a-4acd-bb08-03476f86c70d req-b1f910f7-cb03-487d-a635-f1d766cc54c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49", "name": "network-vif-plugged", "status": "completed", "tag": "b975970e-4ce0-4b1c-b1b3-956befa892e0"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b88572a8-116a-4acd-bb08-03476f86c70d req-b1f910f7-cb03-487d-a635-f1d766cc54c9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b88572a8-116a-4acd-bb08-03476f86c70d req-b1f910f7-cb03-487d-a635-f1d766cc54c9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b88572a8-116a-4acd-bb08-03476f86c70d req-b1f910f7-cb03-487d-a635-f1d766cc54c9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b88572a8-116a-4acd-bb08-03476f86c70d req-b1f910f7-cb03-487d-a635-f1d766cc54c9 service nova] Creating event network-vif-plugged:b975970e-4ce0-4b1c-b1b3-956befa892e0 for instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 on user Apr 14 03:05:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b88572a8-116a-4acd-bb08-03476f86c70d req-b1f910f7-cb03-487d-a635-f1d766cc54c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032112 Apr 14 03:05:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 128/383] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:05:13 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-9b6cee23-e8b9-48e5-bd95-a5a0e4d4659b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:13 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-9b6cee23-e8b9-48e5-bd95-a5a0e4d4659b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 62cad020-0344-4e4e-add9-e5bc6175adbb] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9b6cee23-e8b9-48e5-bd95-a5a0e4d4659b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9b6cee23-e8b9-48e5-bd95-a5a0e4d4659b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9b6cee23-e8b9-48e5-bd95-a5a0e4d4659b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9b6cee23-e8b9-48e5-bd95-a5a0e4d4659b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9b6cee23-e8b9-48e5-bd95-a5a0e4d4659b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9b6cee23-e8b9-48e5-bd95-a5a0e4d4659b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:14 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-9b6cee23-e8b9-48e5-bd95-a5a0e4d4659b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-9b6cee23-e8b9-48e5-bd95-a5a0e4d4659b tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb" status: 200 len: 1551 microversion: 2.1 time: 0.270250 Apr 14 03:05:14 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 127/384] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:05:13 2023] GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb => generated 1551 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:05:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8edab559-a93a-41dc-a620-4feb1be60fb4 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Action: 'create', calling method: .version_select at 0x7ff11a4e3b50>, body: {"keypair": {"name": "tempest-keypair-1544638969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiHBttIIVBNMgMjltJBU4uMIz2as3PoKWtxm6ulgCLbjLzG8l8vypUin+t8362oN6Cvbgl7ijzYK1kaa0BhTC5evtLLqD2wBmJI1qq6z0TNdkAKe43vfhblj5qmB0bwRg=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:21 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-8edab559-a93a-41dc-a620-4feb1be60fb4 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Getting quotas for project 6a991a4fd13b4a819b24479a341ba08c. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:05:21 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-8edab559-a93a-41dc-a620-4feb1be60fb4 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Getting quotas for user 17999fdd4eb449d49d74b4de20f6614a and project 6a991a4fd13b4a819b24479a341ba08c. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:05:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8edab559-a93a-41dc-a620-4feb1be60fb4 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.051298 Apr 14 03:05:21 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 130/385] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 03:05:21 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 03:05:22 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=14 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:22 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=10 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1844029430", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "7f091b9e-2d65-4db6-bca2-3e1f90f68689"}], "security_groups": [{"name": "tempest-securitygroup--1873189736"}], "key_name": "tempest-keypair-1544638969", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:22 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] validate_networks() for [('7f091b9e-2d65-4db6-bca2-3e1f90f68689', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Getting quotas for project 6a991a4fd13b4a819b24479a341ba08c. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Getting quotas for user 17999fdd4eb449d49d74b4de20f6614a and project 6a991a4fd13b4a819b24479a341ba08c. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:05:23 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:05:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5dd6b45f-789e-4cb1-ba44-7e1503fcf3e5 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.661742 Apr 14 03:05:23 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 129/386] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 03:05:22 2023] POST /compute/v2.1/servers => generated 404 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 03:05:23 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-76893f9a-1a74-4c8b-a9b6-72d2df879939 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:23 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-76893f9a-1a74-4c8b-a9b6-72d2df879939 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:23 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-76893f9a-1a74-4c8b-a9b6-72d2df879939 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:23 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-76893f9a-1a74-4c8b-a9b6-72d2df879939 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:23 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-76893f9a-1a74-4c8b-a9b6-72d2df879939 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:23 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-76893f9a-1a74-4c8b-a9b6-72d2df879939 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a" status: 200 len: 1321 microversion: 2.49 time: 0.071013 Apr 14 03:05:23 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 128/387] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:05:23 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a => generated 1321 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:05:24 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-add855f4-3b9b-4794-b26e-f1f9cf982703 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:24 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-add855f4-3b9b-4794-b26e-f1f9cf982703 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-add855f4-3b9b-4794-b26e-f1f9cf982703 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-add855f4-3b9b-4794-b26e-f1f9cf982703 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-add855f4-3b9b-4794-b26e-f1f9cf982703 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-add855f4-3b9b-4794-b26e-f1f9cf982703 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-add855f4-3b9b-4794-b26e-f1f9cf982703 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-add855f4-3b9b-4794-b26e-f1f9cf982703 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-add855f4-3b9b-4794-b26e-f1f9cf982703 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047064 Apr 14 03:05:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 131/388] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:05:24 2023] GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:05:24 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b26d4d4d-3ad0-4883-90ed-e8c5970f43b2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:24 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b26d4d4d-3ad0-4883-90ed-e8c5970f43b2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b26d4d4d-3ad0-4883-90ed-e8c5970f43b2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b26d4d4d-3ad0-4883-90ed-e8c5970f43b2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b26d4d4d-3ad0-4883-90ed-e8c5970f43b2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b26d4d4d-3ad0-4883-90ed-e8c5970f43b2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b26d4d4d-3ad0-4883-90ed-e8c5970f43b2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b26d4d4d-3ad0-4883-90ed-e8c5970f43b2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:24 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b26d4d4d-3ad0-4883-90ed-e8c5970f43b2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b26d4d4d-3ad0-4883-90ed-e8c5970f43b2 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6" status: 200 len: 1503 microversion: 2.1 time: 0.375000 Apr 14 03:05:24 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 130/389] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:05:24 2023] GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 => generated 1503 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:05:25 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-7118858f-2be2-4280-8a4f-d62ad66b5846 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:25 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-7118858f-2be2-4280-8a4f-d62ad66b5846 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:25 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=16 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ca32217e-b3a3-4ae1-b7f2-0043d20fbea0 req-b847c2b6-a9cc-48a1-9dc9-6bba92ef5adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8c2e40-f896-4d21-9927-67330485d77d", "tag": "a36f717a-9a8b-43c9-ba01-0f03a522d166"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7118858f-2be2-4280-8a4f-d62ad66b5846 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7118858f-2be2-4280-8a4f-d62ad66b5846 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7118858f-2be2-4280-8a4f-d62ad66b5846 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7118858f-2be2-4280-8a4f-d62ad66b5846 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7118858f-2be2-4280-8a4f-d62ad66b5846 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7118858f-2be2-4280-8a4f-d62ad66b5846 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ca32217e-b3a3-4ae1-b7f2-0043d20fbea0 req-b847c2b6-a9cc-48a1-9dc9-6bba92ef5adf service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ca32217e-b3a3-4ae1-b7f2-0043d20fbea0 req-b847c2b6-a9cc-48a1-9dc9-6bba92ef5adf service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ca32217e-b3a3-4ae1-b7f2-0043d20fbea0 req-b847c2b6-a9cc-48a1-9dc9-6bba92ef5adf service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ca32217e-b3a3-4ae1-b7f2-0043d20fbea0 req-b847c2b6-a9cc-48a1-9dc9-6bba92ef5adf service nova] Creating event network-changed:a36f717a-9a8b-43c9-ba01-0f03a522d166 for instance dc8c2e40-f896-4d21-9927-67330485d77d on user Apr 14 03:05:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ca32217e-b3a3-4ae1-b7f2-0043d20fbea0 req-b847c2b6-a9cc-48a1-9dc9-6bba92ef5adf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030415 Apr 14 03:05:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 132/390] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:05:25 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-7118858f-2be2-4280-8a4f-d62ad66b5846 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:05:25 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-7118858f-2be2-4280-8a4f-d62ad66b5846 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d" status: 204 len: 0 microversion: 2.1 time: 0.123196 Apr 14 03:05:25 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 129/391] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:05:25 2023] DELETE /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:05:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5267e7c4-4f26-4747-b93a-d0aff3554564 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:25 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5267e7c4-4f26-4747-b93a-d0aff3554564 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5267e7c4-4f26-4747-b93a-d0aff3554564 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5267e7c4-4f26-4747-b93a-d0aff3554564 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5267e7c4-4f26-4747-b93a-d0aff3554564 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5267e7c4-4f26-4747-b93a-d0aff3554564 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5267e7c4-4f26-4747-b93a-d0aff3554564 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5267e7c4-4f26-4747-b93a-d0aff3554564 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:25 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-5267e7c4-4f26-4747-b93a-d0aff3554564 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337e2d8118324215b5a0baa36a5895b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6371b4c05df843da9b134e12994c1d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5267e7c4-4f26-4747-b93a-d0aff3554564 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d" status: 200 len: 1659 microversion: 2.1 time: 0.255131 Apr 14 03:05:25 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 131/392] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:05:25 2023] GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d => generated 1659 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:05:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-76fb2917-a544-45fb-be06-3b07a5a7cefc req-e718baca-8592-4637-9b05-80d6bda36743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8c2e40-f896-4d21-9927-67330485d77d", "name": "network-vif-unplugged", "status": "completed", "tag": "a36f717a-9a8b-43c9-ba01-0f03a522d166"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-76fb2917-a544-45fb-be06-3b07a5a7cefc req-e718baca-8592-4637-9b05-80d6bda36743 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-76fb2917-a544-45fb-be06-3b07a5a7cefc req-e718baca-8592-4637-9b05-80d6bda36743 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-76fb2917-a544-45fb-be06-3b07a5a7cefc req-e718baca-8592-4637-9b05-80d6bda36743 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-76fb2917-a544-45fb-be06-3b07a5a7cefc req-e718baca-8592-4637-9b05-80d6bda36743 service nova] Creating event network-vif-unplugged:a36f717a-9a8b-43c9-ba01-0f03a522d166 for instance dc8c2e40-f896-4d21-9927-67330485d77d on user Apr 14 03:05:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-76fb2917-a544-45fb-be06-3b07a5a7cefc req-e718baca-8592-4637-9b05-80d6bda36743 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035006 Apr 14 03:05:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 133/393] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:27 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-e9f3f15f-d065-4b07-8d38-4b10ec805ba4 req-552d9e37-4fa4-4940-8886-95db88822e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "tag": "fb9a2be7-8d62-4528-a23c-bfdf995bd6dc"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e9f3f15f-d065-4b07-8d38-4b10ec805ba4 req-552d9e37-4fa4-4940-8886-95db88822e22 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e9f3f15f-d065-4b07-8d38-4b10ec805ba4 req-552d9e37-4fa4-4940-8886-95db88822e22 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e9f3f15f-d065-4b07-8d38-4b10ec805ba4 req-552d9e37-4fa4-4940-8886-95db88822e22 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:27 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-e9f3f15f-d065-4b07-8d38-4b10ec805ba4 req-552d9e37-4fa4-4940-8886-95db88822e22 service nova] Creating event network-changed:fb9a2be7-8d62-4528-a23c-bfdf995bd6dc for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:05:27 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-e9f3f15f-d065-4b07-8d38-4b10ec805ba4 req-552d9e37-4fa4-4940-8886-95db88822e22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034254 Apr 14 03:05:27 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 130/394] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b8d8a6f7-50ab-4eb5-ae2d-9bd31e07b5a3 req-3308cb81-4714-4c68-8fc9-65dd7c323eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8c2e40-f896-4d21-9927-67330485d77d", "name": "network-vif-plugged", "status": "completed", "tag": "a36f717a-9a8b-43c9-ba01-0f03a522d166"}, {"server_uuid": "dc8c2e40-f896-4d21-9927-67330485d77d", "name": "network-vif-deleted", "tag": "a36f717a-9a8b-43c9-ba01-0f03a522d166"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b8d8a6f7-50ab-4eb5-ae2d-9bd31e07b5a3 req-3308cb81-4714-4c68-8fc9-65dd7c323eec service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b8d8a6f7-50ab-4eb5-ae2d-9bd31e07b5a3 req-3308cb81-4714-4c68-8fc9-65dd7c323eec service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b8d8a6f7-50ab-4eb5-ae2d-9bd31e07b5a3 req-3308cb81-4714-4c68-8fc9-65dd7c323eec service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b8d8a6f7-50ab-4eb5-ae2d-9bd31e07b5a3 req-3308cb81-4714-4c68-8fc9-65dd7c323eec service nova] Creating event network-vif-plugged:a36f717a-9a8b-43c9-ba01-0f03a522d166 for instance dc8c2e40-f896-4d21-9927-67330485d77d on user Apr 14 03:05:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b8d8a6f7-50ab-4eb5-ae2d-9bd31e07b5a3 req-3308cb81-4714-4c68-8fc9-65dd7c323eec service nova] Creating event network-vif-deleted:a36f717a-9a8b-43c9-ba01-0f03a522d166 for instance dc8c2e40-f896-4d21-9927-67330485d77d on user Apr 14 03:05:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b8d8a6f7-50ab-4eb5-ae2d-9bd31e07b5a3 req-3308cb81-4714-4c68-8fc9-65dd7c323eec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030911 Apr 14 03:05:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 132/395] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-44786c52-2c5b-4265-a2bb-bef7e05d6648 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-350029710", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "98e6a247-250b-4bb5-a947-e7f93598d16e", "destination_type": "local"}, {"source_type": "volume", "uuid": "c2a62774-7c33-4899-b77f-cf1bfa85175a", "destination_type": "invalid"}], "networks": [{"uuid": "47266f26-ea7c-404a-9098-264e4a1e0ab6"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-44786c52-2c5b-4265-a2bb-bef7e05d6648 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Request method failure captured: Apr 14 03:05:28 user devstack@n-api.service[61663]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 03:05:28 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:05:28 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:05:28 user devstack@n-api.service[61663]: Connection: close Apr 14 03:05:28 user devstack@n-api.service[61663]: Content-Length: 493 Apr 14 03:05:28 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:05:28 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:05:28 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:05:28 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMErwVvPJsjUJ3S0QPyBJwBGtPnN1VrL3KnPjbADURknqA0wkUZZ5eDBWtFcjFYFZZHeZil6ND7vyIhrBBYG50lpIyAGWg_8e4VgQYZfVgC3Jnm7MzkAyKb0p5axf2vM_aHXSvfx_x6W7PR7se8sYOcQ30uo0Jm_JeFuB_bek1E7GOY Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Project-Id: f021342634dd4f16bf2720533070154c Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f021342634dd4f16bf2720533070154c"}]}] Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Tenant: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Tenant-Id: f021342634dd4f16bf2720533070154c Apr 14 03:05:28 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:05:28 user devstack@n-api.service[61663]: X-User: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:05:28 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:05:28 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:05:28 user devstack@n-api.service[61663]: X-User-Id: 0dbce21e767a4a61b9213e38523d247e Apr 14 03:05:28 user devstack@n-api.service[61663]: X-User-Name: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:05:28 user devstack@n-api.service[61663]: Apr 14 03:05:28 user devstack@n-api.service[61663]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-350029710", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "98e6a247-250b-4bb5-a947-e7f93598d16e", "destination_type": "local"}, {"source_type": "volume", "uuid": "c2a62774-7c33-4899-b77f-cf1bfa85175a", "destination_type": "invalid"}], "networks": [{"uuid": "47266f26-ea7c-404a-9098-264e4a1e0ab6"}]}} Apr 14 03:05:28 user devstack@n-api.service[61663]: method: > Apr 14 03:05:28 user devstack@n-api.service[61663]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 03:05:28 user devstack@n-api.service[61663]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-350029710', 'imageRef': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c2a62774-7c33-4899-b77f-cf1bfa85175a', 'destination_type': 'invalid'}], 'networks': [{'uuid': '47266f26-ea7c-404a-9098-264e4a1e0ab6'}]}}} Apr 14 03:05:28 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise error Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 03:05:28 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:05:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-44786c52-2c5b-4265-a2bb-bef7e05d6648 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:05:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-44786c52-2c5b-4265-a2bb-bef7e05d6648 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010912 Apr 14 03:05:28 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 134/396] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:05:28 2023] POST /compute/v2.1/servers => generated 155 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:05:28 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-bed92ec0-d64c-476b-85f8-62320e83ad02 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:28 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-bed92ec0-d64c-476b-85f8-62320e83ad02 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bed92ec0-d64c-476b-85f8-62320e83ad02 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bed92ec0-d64c-476b-85f8-62320e83ad02 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bed92ec0-d64c-476b-85f8-62320e83ad02 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bed92ec0-d64c-476b-85f8-62320e83ad02 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bed92ec0-d64c-476b-85f8-62320e83ad02 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bed92ec0-d64c-476b-85f8-62320e83ad02 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:28 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-bed92ec0-d64c-476b-85f8-62320e83ad02 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbce21e767a4a61b9213e38523d247e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021342634dd4f16bf2720533070154c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:28 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-bed92ec0-d64c-476b-85f8-62320e83ad02 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b" status: 200 len: 1493 microversion: 2.1 time: 0.146518 Apr 14 03:05:28 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 131/397] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:05:28 2023] GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b => generated 1493 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:05:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f2bf238d-675e-4aea-ba2e-31ea522e275e req-f3b7ac93-9f4a-4354-8dc3-397c68bc4ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "name": "network-vif-plugged", "status": "completed", "tag": "fb9a2be7-8d62-4528-a23c-bfdf995bd6dc"}, {"server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "name": "network-vif-plugged", "status": "completed", "tag": "fb9a2be7-8d62-4528-a23c-bfdf995bd6dc"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f2bf238d-675e-4aea-ba2e-31ea522e275e req-f3b7ac93-9f4a-4354-8dc3-397c68bc4ec3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f2bf238d-675e-4aea-ba2e-31ea522e275e req-f3b7ac93-9f4a-4354-8dc3-397c68bc4ec3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f2bf238d-675e-4aea-ba2e-31ea522e275e req-f3b7ac93-9f4a-4354-8dc3-397c68bc4ec3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f2bf238d-675e-4aea-ba2e-31ea522e275e req-f3b7ac93-9f4a-4354-8dc3-397c68bc4ec3 service nova] Creating event network-vif-plugged:fb9a2be7-8d62-4528-a23c-bfdf995bd6dc for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:05:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f2bf238d-675e-4aea-ba2e-31ea522e275e req-f3b7ac93-9f4a-4354-8dc3-397c68bc4ec3 service nova] Creating event network-vif-plugged:fb9a2be7-8d62-4528-a23c-bfdf995bd6dc for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:05:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f2bf238d-675e-4aea-ba2e-31ea522e275e req-f3b7ac93-9f4a-4354-8dc3-397c68bc4ec3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031675 Apr 14 03:05:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 133/398] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:32 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5dfe1a6b-7e20-4230-aa80-25dab14b96f1 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:32 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5dfe1a6b-7e20-4230-aa80-25dab14b96f1 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5dfe1a6b-7e20-4230-aa80-25dab14b96f1 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5dfe1a6b-7e20-4230-aa80-25dab14b96f1 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5dfe1a6b-7e20-4230-aa80-25dab14b96f1 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Going to try to start instance {{(pid=61663) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 03:05:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5dfe1a6b-7e20-4230-aa80-25dab14b96f1 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/action" status: 202 len: 0 microversion: 2.1 time: 0.115821 Apr 14 03:05:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 135/399] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:05:32 2023] POST /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:05:32 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-e5ec8f23-b661-4226-9063-632561b6ca99 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:32 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-e5ec8f23-b661-4226-9063-632561b6ca99 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:32 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e5ec8f23-b661-4226-9063-632561b6ca99 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e5ec8f23-b661-4226-9063-632561b6ca99 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e5ec8f23-b661-4226-9063-632561b6ca99 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e5ec8f23-b661-4226-9063-632561b6ca99 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e5ec8f23-b661-4226-9063-632561b6ca99 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e5ec8f23-b661-4226-9063-632561b6ca99 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:33 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-e5ec8f23-b661-4226-9063-632561b6ca99 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:33 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-e5ec8f23-b661-4226-9063-632561b6ca99 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1651 microversion: 2.1 time: 0.396380 Apr 14 03:05:33 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 132/400] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:05:32 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1651 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 03:05:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a419e870-f9d5-4cbb-a16f-8f563fcac8eb req-7f178801-1ae8-483d-9d30-b1768db4ec61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a419e870-f9d5-4cbb-a16f-8f563fcac8eb req-7f178801-1ae8-483d-9d30-b1768db4ec61 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a419e870-f9d5-4cbb-a16f-8f563fcac8eb req-7f178801-1ae8-483d-9d30-b1768db4ec61 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a419e870-f9d5-4cbb-a16f-8f563fcac8eb req-7f178801-1ae8-483d-9d30-b1768db4ec61 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a419e870-f9d5-4cbb-a16f-8f563fcac8eb req-7f178801-1ae8-483d-9d30-b1768db4ec61 service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:05:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a419e870-f9d5-4cbb-a16f-8f563fcac8eb req-7f178801-1ae8-483d-9d30-b1768db4ec61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044199 Apr 14 03:05:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 134/401] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9d3f22e8-e20d-4ba1-8c84-5c657119b6a7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-9d3f22e8-e20d-4ba1-8c84-5c657119b6a7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9d3f22e8-e20d-4ba1-8c84-5c657119b6a7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9d3f22e8-e20d-4ba1-8c84-5c657119b6a7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9d3f22e8-e20d-4ba1-8c84-5c657119b6a7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9d3f22e8-e20d-4ba1-8c84-5c657119b6a7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9d3f22e8-e20d-4ba1-8c84-5c657119b6a7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9d3f22e8-e20d-4ba1-8c84-5c657119b6a7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9d3f22e8-e20d-4ba1-8c84-5c657119b6a7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048835 Apr 14 03:05:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 136/402] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:05:37 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:05:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-2416d6a1-e83e-4e25-8e59-206332faf425 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:37 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-2416d6a1-e83e-4e25-8e59-206332faf425 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:37 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2416d6a1-e83e-4e25-8e59-206332faf425 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2416d6a1-e83e-4e25-8e59-206332faf425 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2416d6a1-e83e-4e25-8e59-206332faf425 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2416d6a1-e83e-4e25-8e59-206332faf425 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2416d6a1-e83e-4e25-8e59-206332faf425 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2416d6a1-e83e-4e25-8e59-206332faf425 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:37 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-2416d6a1-e83e-4e25-8e59-206332faf425 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-2416d6a1-e83e-4e25-8e59-206332faf425 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1675 microversion: 2.1 time: 0.143621 Apr 14 03:05:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 133/403] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:05:37 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1675 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:05:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-68802536-7e7f-4432-bc87-34774efede6c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:37 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-68802536-7e7f-4432-bc87-34774efede6c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68802536-7e7f-4432-bc87-34774efede6c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68802536-7e7f-4432-bc87-34774efede6c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68802536-7e7f-4432-bc87-34774efede6c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68802536-7e7f-4432-bc87-34774efede6c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68802536-7e7f-4432-bc87-34774efede6c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68802536-7e7f-4432-bc87-34774efede6c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:37 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-68802536-7e7f-4432-bc87-34774efede6c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-68802536-7e7f-4432-bc87-34774efede6c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1675 microversion: 2.1 time: 0.195256 Apr 14 03:05:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 135/404] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:05:37 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3735a185-ddbb-45ba-ae44-6bc38f8a9991 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3735a185-ddbb-45ba-ae44-6bc38f8a9991 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3735a185-ddbb-45ba-ae44-6bc38f8a9991 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3735a185-ddbb-45ba-ae44-6bc38f8a9991 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3735a185-ddbb-45ba-ae44-6bc38f8a9991 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3735a185-ddbb-45ba-ae44-6bc38f8a9991 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3735a185-ddbb-45ba-ae44-6bc38f8a9991 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3735a185-ddbb-45ba-ae44-6bc38f8a9991 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:38 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-3735a185-ddbb-45ba-ae44-6bc38f8a9991 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3735a185-ddbb-45ba-ae44-6bc38f8a9991 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1675 microversion: 2.1 time: 0.147267 Apr 14 03:05:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 137/405] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:05:37 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:05:38 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-0b455d2c-e384-4418-ad2d-436f56f1f5ff req-4cc087f1-0afb-4d40-822b-5cf61b0f9d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:05:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0b455d2c-e384-4418-ad2d-436f56f1f5ff req-4cc087f1-0afb-4d40-822b-5cf61b0f9d79 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0b455d2c-e384-4418-ad2d-436f56f1f5ff req-4cc087f1-0afb-4d40-822b-5cf61b0f9d79 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0b455d2c-e384-4418-ad2d-436f56f1f5ff req-4cc087f1-0afb-4d40-822b-5cf61b0f9d79 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-0b455d2c-e384-4418-ad2d-436f56f1f5ff req-4cc087f1-0afb-4d40-822b-5cf61b0f9d79 service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:05:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-0b455d2c-e384-4418-ad2d-436f56f1f5ff req-4cc087f1-0afb-4d40-822b-5cf61b0f9d79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033644 Apr 14 03:05:38 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 134/406] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:05:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=26 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:48 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:05:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-45129000-9e05-4da5-a38c-710270c40605 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e" status: 200 len: 1690 microversion: 2.87 time: 0.197421 Apr 14 03:05:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 136/407] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:05:48 2023] GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e => generated 1690 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] [instance: b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=5 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] HTTP exception thrown: Instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 could not be found. Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Request method failure captured: Apr 14 03:06:00 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 HTTP/1.1 Apr 14 03:06:00 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:06:00 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:06:00 user devstack@n-api.service[61663]: Connection: close Apr 14 03:06:00 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:06:00 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:06:00 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:06:00 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:06:00 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMIVJZFSTcDylzBQRKWqf40JrkIOvHUgy1mES7xlscXsmPpLEiBjSqMBWhpLQfpDX9YJceZ3YOt1sfitUIDXmKBRwjbHYfU6e10Eo0xsTqZPhtJEvGMWmT-3-BayRHE0TDIeCY9UpBPtiXu8hlWpHCqTNCsqcavekweLScd6l3RAjmY Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Project-Id: f987064bf0ed4a2fa8714064fe8b43c8 Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestVolumeSwap-1328008515 Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f987064bf0ed4a2fa8714064fe8b43c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f987064bf0ed4a2fa8714064fe8b43c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f987064bf0ed4a2fa8714064fe8b43c8"}]}] Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Tenant: tempest-TestVolumeSwap-1328008515 Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Tenant-Id: f987064bf0ed4a2fa8714064fe8b43c8 Apr 14 03:06:00 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestVolumeSwap-1328008515 Apr 14 03:06:00 user devstack@n-api.service[61663]: X-User: tempest-TestVolumeSwap-1328008515-project-member Apr 14 03:06:00 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:06:00 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:06:00 user devstack@n-api.service[61663]: X-User-Id: f089c5c093754f8082181a8fc1c002f4 Apr 14 03:06:00 user devstack@n-api.service[61663]: X-User-Name: tempest-TestVolumeSwap-1328008515-project-member Apr 14 03:06:00 user devstack@n-api.service[61663]: method: > Apr 14 03:06:00 user devstack@n-api.service[61663]: exception: Instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 could not be found. Apr 14 03:06:00 user devstack@n-api.service[61663]: action_args: {'id': 'b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49'} Apr 14 03:06:00 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 could not be found. Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 could not be found. Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 could not be found. Apr 14 03:06:00 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:06:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Returning 404 to user: Instance b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:06:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6653ac5a-5f67-469e-a7e3-8cf840b39d93 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49" status: 404 len: 111 microversion: 2.1 time: 0.055164 Apr 14 03:06:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 138/408] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:00 2023] GET /compute/v2.1/servers/b06dcbb8-bb2d-4789-9e0a-0388cf4c9b49 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:06:00 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=5 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:00 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:00 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-506d82e1-a73e-47c0-adda-ce114e0db497 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] Calling method '.version_select at 0x7ff11a4b52d0>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:00 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-506d82e1-a73e-47c0-adda-ce114e0db497 tempest-TestVolumeSwap-1328008515 tempest-TestVolumeSwap-1328008515-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-603146841" status: 202 len: 0 microversion: 2.1 time: 0.039055 Apr 14 03:06:00 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 135/409] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 03:06:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-603146841 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:13 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-67e74cb0-4cff-4c37-87b3-f85ccc8c530e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a" status: 200 len: 1628 microversion: 2.49 time: 0.299135 Apr 14 03:06:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 137/410] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:06:13 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a => generated 1628 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-61061b3c-8993-4db8-8c56-84afbe141b25 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-61061b3c-8993-4db8-8c56-84afbe141b25 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 62cad020-0344-4e4e-add9-e5bc6175adbb] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-61061b3c-8993-4db8-8c56-84afbe141b25 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-61061b3c-8993-4db8-8c56-84afbe141b25 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-61061b3c-8993-4db8-8c56-84afbe141b25 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-61061b3c-8993-4db8-8c56-84afbe141b25 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-61061b3c-8993-4db8-8c56-84afbe141b25 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-61061b3c-8993-4db8-8c56-84afbe141b25 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-61061b3c-8993-4db8-8c56-84afbe141b25 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-61061b3c-8993-4db8-8c56-84afbe141b25 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb" status: 200 len: 1551 microversion: 2.1 time: 0.184449 Apr 14 03:06:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 139/411] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:14 2023] GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb => generated 1551 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:06:14 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:14 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 62cad020-0344-4e4e-add9-e5bc6175adbb] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:14 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 62cad020-0344-4e4e-add9-e5bc6175adbb] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:06:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb" status: 204 len: 0 microversion: 2.1 time: 0.132692 Apr 14 03:06:14 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 136/412] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:06:14 2023] DELETE /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:06:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-efe46d93-366d-4c98-a507-cb73cddee49d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:14 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-efe46d93-366d-4c98-a507-cb73cddee49d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 62cad020-0344-4e4e-add9-e5bc6175adbb] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efe46d93-366d-4c98-a507-cb73cddee49d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efe46d93-366d-4c98-a507-cb73cddee49d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efe46d93-366d-4c98-a507-cb73cddee49d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efe46d93-366d-4c98-a507-cb73cddee49d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efe46d93-366d-4c98-a507-cb73cddee49d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efe46d93-366d-4c98-a507-cb73cddee49d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:14 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-efe46d93-366d-4c98-a507-cb73cddee49d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-efe46d93-366d-4c98-a507-cb73cddee49d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb" status: 200 len: 1557 microversion: 2.1 time: 0.204768 Apr 14 03:06:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 138/413] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:14 2023] GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb => generated 1557 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ec2e6e73-31e4-4a58-8c1c-6fe42a39562b req-313a5ba2-19cd-46a6-9e71-f1f909f1c05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cad020-0344-4e4e-add9-e5bc6175adbb", "name": "network-vif-unplugged", "status": "completed", "tag": "a07f6861-f9f6-42c0-8d36-07db58ad1cb2"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ec2e6e73-31e4-4a58-8c1c-6fe42a39562b req-313a5ba2-19cd-46a6-9e71-f1f909f1c05a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ec2e6e73-31e4-4a58-8c1c-6fe42a39562b req-313a5ba2-19cd-46a6-9e71-f1f909f1c05a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ec2e6e73-31e4-4a58-8c1c-6fe42a39562b req-313a5ba2-19cd-46a6-9e71-f1f909f1c05a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ec2e6e73-31e4-4a58-8c1c-6fe42a39562b req-313a5ba2-19cd-46a6-9e71-f1f909f1c05a service nova] Creating event network-vif-unplugged:a07f6861-f9f6-42c0-8d36-07db58ad1cb2 for instance 62cad020-0344-4e4e-add9-e5bc6175adbb on user Apr 14 03:06:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ec2e6e73-31e4-4a58-8c1c-6fe42a39562b req-313a5ba2-19cd-46a6-9e71-f1f909f1c05a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036896 Apr 14 03:06:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 140/414] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:15 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:15 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: dc8c2e40-f896-4d21-9927-67330485d77d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] HTTP exception thrown: Instance dc8c2e40-f896-4d21-9927-67330485d77d could not be found. Apr 14 03:06:15 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Request method failure captured: Apr 14 03:06:15 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d HTTP/1.1 Apr 14 03:06:15 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:06:15 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:06:15 user devstack@n-api.service[61662]: Connection: close Apr 14 03:06:15 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:06:15 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:06:15 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:06:15 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:06:15 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMF-cxMM8Zg-1HxO7Hg0COB4TfXRsitd3vZgCa-KlJQ7oJuhqw9Yw9ibckvkMm6bFnKJcm9F1ma5LzyLyjIxLV8y7ooOqb7M12lHeoS1kYyftcZARhZpQFpCG5IBJz1rQZChnLNsrXGpr5IelSiJktoJlRrKb03IeWUcmwwjBy0NPps Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Project-Id: 6371b4c05df843da9b134e12994c1d7a Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Project-Name: tempest-TestStampPattern-323884970 Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6371b4c05df843da9b134e12994c1d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6371b4c05df843da9b134e12994c1d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6371b4c05df843da9b134e12994c1d7a"}]}] Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Tenant: tempest-TestStampPattern-323884970 Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Tenant-Id: 6371b4c05df843da9b134e12994c1d7a Apr 14 03:06:15 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TestStampPattern-323884970 Apr 14 03:06:15 user devstack@n-api.service[61662]: X-User: tempest-TestStampPattern-323884970-project-member Apr 14 03:06:15 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:06:15 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:06:15 user devstack@n-api.service[61662]: X-User-Id: 337e2d8118324215b5a0baa36a5895b0 Apr 14 03:06:15 user devstack@n-api.service[61662]: X-User-Name: tempest-TestStampPattern-323884970-project-member Apr 14 03:06:15 user devstack@n-api.service[61662]: method: > Apr 14 03:06:15 user devstack@n-api.service[61662]: exception: Instance dc8c2e40-f896-4d21-9927-67330485d77d could not be found. Apr 14 03:06:15 user devstack@n-api.service[61662]: action_args: {'id': 'dc8c2e40-f896-4d21-9927-67330485d77d'} Apr 14 03:06:15 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8c2e40-f896-4d21-9927-67330485d77d could not be found. Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8c2e40-f896-4d21-9927-67330485d77d could not be found. Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8c2e40-f896-4d21-9927-67330485d77d could not be found. Apr 14 03:06:15 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:15 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Returning 404 to user: Instance dc8c2e40-f896-4d21-9927-67330485d77d could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:06:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-8083a1c5-3deb-4d54-a3f2-72bb57ad0350 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d" status: 404 len: 111 microversion: 2.1 time: 0.032853 Apr 14 03:06:15 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 137/415] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:15 2023] GET /compute/v2.1/servers/dc8c2e40-f896-4d21-9927-67330485d77d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:06:16 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d0c53d5f-6e29-41ba-9172-0111706416ef req-c53cf943-f599-4c3f-9132-18834118c4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cad020-0344-4e4e-add9-e5bc6175adbb", "name": "network-vif-deleted", "tag": "a07f6861-f9f6-42c0-8d36-07db58ad1cb2"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d0c53d5f-6e29-41ba-9172-0111706416ef req-c53cf943-f599-4c3f-9132-18834118c4c2 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d0c53d5f-6e29-41ba-9172-0111706416ef req-c53cf943-f599-4c3f-9132-18834118c4c2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d0c53d5f-6e29-41ba-9172-0111706416ef req-c53cf943-f599-4c3f-9132-18834118c4c2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:16 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d0c53d5f-6e29-41ba-9172-0111706416ef req-c53cf943-f599-4c3f-9132-18834118c4c2 service nova] Creating event network-vif-deleted:a07f6861-f9f6-42c0-8d36-07db58ad1cb2 for instance 62cad020-0344-4e4e-add9-e5bc6175adbb on user Apr 14 03:06:16 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d0c53d5f-6e29-41ba-9172-0111706416ef req-c53cf943-f599-4c3f-9132-18834118c4c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037502 Apr 14 03:06:16 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 139/416] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-efd4f746-0c93-45f9-8969-4c3f344336f9 req-0799ae4b-b651-450f-bfb8-0cedc9b41c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cad020-0344-4e4e-add9-e5bc6175adbb", "name": "network-vif-plugged", "status": "completed", "tag": "a07f6861-f9f6-42c0-8d36-07db58ad1cb2"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-efd4f746-0c93-45f9-8969-4c3f344336f9 req-0799ae4b-b651-450f-bfb8-0cedc9b41c86 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-efd4f746-0c93-45f9-8969-4c3f344336f9 req-0799ae4b-b651-450f-bfb8-0cedc9b41c86 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-efd4f746-0c93-45f9-8969-4c3f344336f9 req-0799ae4b-b651-450f-bfb8-0cedc9b41c86 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-efd4f746-0c93-45f9-8969-4c3f344336f9 req-0799ae4b-b651-450f-bfb8-0cedc9b41c86 service nova] Creating event network-vif-plugged:a07f6861-f9f6-42c0-8d36-07db58ad1cb2 for instance 62cad020-0344-4e4e-add9-e5bc6175adbb on user Apr 14 03:06:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-efd4f746-0c93-45f9-8969-4c3f344336f9 req-0799ae4b-b651-450f-bfb8-0cedc9b41c86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076508 Apr 14 03:06:17 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 141/417] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:22 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:22 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:22 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] HTTP exception thrown: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 is not attached to volume edd92bd4-26a2-4652-bdc6-77805711142a Apr 14 03:06:22 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Request method failure captured: Apr 14 03:06:22 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments/edd92bd4-26a2-4652-bdc6-77805711142a HTTP/1.1 Apr 14 03:06:22 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:06:22 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:06:22 user devstack@n-api.service[61662]: Connection: close Apr 14 03:06:22 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:06:22 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:06:22 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:06:22 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:06:22 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMF-cxMM8Zg-1HxO7Hg0COB4TfXRsitd3vZgCa-KlJQ7oJuhqw9Yw9ibckvkMm6bFnKJcm9F1ma5LzyLyjIxLV8y7ooOqb7M12lHeoS1kYyftcZARhZpQFpCG5IBJz1rQZChnLNsrXGpr5IelSiJktoJlRrKb03IeWUcmwwjBy0NPps Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Project-Id: 6371b4c05df843da9b134e12994c1d7a Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Project-Name: tempest-TestStampPattern-323884970 Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6371b4c05df843da9b134e12994c1d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6371b4c05df843da9b134e12994c1d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6371b4c05df843da9b134e12994c1d7a"}]}] Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Tenant: tempest-TestStampPattern-323884970 Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Tenant-Id: 6371b4c05df843da9b134e12994c1d7a Apr 14 03:06:22 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TestStampPattern-323884970 Apr 14 03:06:22 user devstack@n-api.service[61662]: X-User: tempest-TestStampPattern-323884970-project-member Apr 14 03:06:22 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:06:22 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:06:22 user devstack@n-api.service[61662]: X-User-Id: 337e2d8118324215b5a0baa36a5895b0 Apr 14 03:06:22 user devstack@n-api.service[61662]: X-User-Name: tempest-TestStampPattern-323884970-project-member Apr 14 03:06:22 user devstack@n-api.service[61662]: method: > Apr 14 03:06:22 user devstack@n-api.service[61662]: exception: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 is not attached to volume edd92bd4-26a2-4652-bdc6-77805711142a Apr 14 03:06:22 user devstack@n-api.service[61662]: action_args: {'server_id': '2ca84990-b165-4d0b-a917-307cd8f96f28', 'id': 'edd92bd4-26a2-4652-bdc6-77805711142a'} Apr 14 03:06:22 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id edd92bd4-26a2-4652-bdc6-77805711142a. Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 is not attached to volume edd92bd4-26a2-4652-bdc6-77805711142a Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 is not attached to volume edd92bd4-26a2-4652-bdc6-77805711142a Apr 14 03:06:22 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:22 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Returning 404 to user: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 is not attached to volume edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:06:22 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-94bf6f6a-b88f-4c86-aacf-08b4bf8250bc tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments/edd92bd4-26a2-4652-bdc6-77805711142a" status: 404 len: 154 microversion: 2.1 time: 0.102308 Apr 14 03:06:22 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 138/418] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:06:22 2023] DELETE /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28/os-volume_attachments/edd92bd4-26a2-4652-bdc6-77805711142a => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:06:23 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-91ab0770-3225-459c-9e35-bfa7b932f01a tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:23 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-91ab0770-3225-459c-9e35-bfa7b932f01a tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-91ab0770-3225-459c-9e35-bfa7b932f01a tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-91ab0770-3225-459c-9e35-bfa7b932f01a tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-91ab0770-3225-459c-9e35-bfa7b932f01a tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-91ab0770-3225-459c-9e35-bfa7b932f01a tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-91ab0770-3225-459c-9e35-bfa7b932f01a tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-91ab0770-3225-459c-9e35-bfa7b932f01a tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:23 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-91ab0770-3225-459c-9e35-bfa7b932f01a tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-91ab0770-3225-459c-9e35-bfa7b932f01a tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1655 microversion: 2.1 time: 0.270780 Apr 14 03:06:23 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 140/419] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:23 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1655 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:06:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1d042601-8d0f-4eff-82f1-0a8a07e7b115 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:24 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1d042601-8d0f-4eff-82f1-0a8a07e7b115 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-4dca01c2-05d7-4eac-b23d-56e3c023d056 req-37988397-38d4-4837-8998-1d9e4caada41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca84990-b165-4d0b-a917-307cd8f96f28", "tag": "920aad6f-1d46-48d5-81eb-95ffbc851da0"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d042601-8d0f-4eff-82f1-0a8a07e7b115 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d042601-8d0f-4eff-82f1-0a8a07e7b115 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d042601-8d0f-4eff-82f1-0a8a07e7b115 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d042601-8d0f-4eff-82f1-0a8a07e7b115 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d042601-8d0f-4eff-82f1-0a8a07e7b115 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d042601-8d0f-4eff-82f1-0a8a07e7b115 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-4dca01c2-05d7-4eac-b23d-56e3c023d056 req-37988397-38d4-4837-8998-1d9e4caada41 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-4dca01c2-05d7-4eac-b23d-56e3c023d056 req-37988397-38d4-4837-8998-1d9e4caada41 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-4dca01c2-05d7-4eac-b23d-56e3c023d056 req-37988397-38d4-4837-8998-1d9e4caada41 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-4dca01c2-05d7-4eac-b23d-56e3c023d056 req-37988397-38d4-4837-8998-1d9e4caada41 service nova] Creating event network-changed:920aad6f-1d46-48d5-81eb-95ffbc851da0 for instance 2ca84990-b165-4d0b-a917-307cd8f96f28 on user Apr 14 03:06:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-4dca01c2-05d7-4eac-b23d-56e3c023d056 req-37988397-38d4-4837-8998-1d9e4caada41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030949 Apr 14 03:06:24 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 139/420] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:24 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1d042601-8d0f-4eff-82f1-0a8a07e7b115 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:06:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1d042601-8d0f-4eff-82f1-0a8a07e7b115 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28" status: 204 len: 0 microversion: 2.1 time: 0.119464 Apr 14 03:06:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 142/421] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:06:24 2023] DELETE /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:06:24 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9bb8204b-8902-4d3a-b406-db768c0727ac tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:24 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9bb8204b-8902-4d3a-b406-db768c0727ac tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9bb8204b-8902-4d3a-b406-db768c0727ac tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9bb8204b-8902-4d3a-b406-db768c0727ac tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9bb8204b-8902-4d3a-b406-db768c0727ac tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9bb8204b-8902-4d3a-b406-db768c0727ac tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9bb8204b-8902-4d3a-b406-db768c0727ac tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9bb8204b-8902-4d3a-b406-db768c0727ac tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:24 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-9bb8204b-8902-4d3a-b406-db768c0727ac tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337e2d8118324215b5a0baa36a5895b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6371b4c05df843da9b134e12994c1d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9bb8204b-8902-4d3a-b406-db768c0727ac tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28" status: 200 len: 1662 microversion: 2.1 time: 0.179848 Apr 14 03:06:24 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 141/422] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:24 2023] GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28 => generated 1662 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:06:26 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-e4c5e27e-06fe-42a7-be0f-f3b27d148907 req-8af9cada-e8a3-4edb-ab90-4129a8347658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca84990-b165-4d0b-a917-307cd8f96f28", "name": "network-vif-unplugged", "status": "completed", "tag": "920aad6f-1d46-48d5-81eb-95ffbc851da0"}, {"server_uuid": "2ca84990-b165-4d0b-a917-307cd8f96f28", "name": "network-vif-plugged", "status": "completed", "tag": "920aad6f-1d46-48d5-81eb-95ffbc851da0"}, {"server_uuid": "2ca84990-b165-4d0b-a917-307cd8f96f28", "name": "network-vif-deleted", "tag": "920aad6f-1d46-48d5-81eb-95ffbc851da0"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e4c5e27e-06fe-42a7-be0f-f3b27d148907 req-8af9cada-e8a3-4edb-ab90-4129a8347658 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e4c5e27e-06fe-42a7-be0f-f3b27d148907 req-8af9cada-e8a3-4edb-ab90-4129a8347658 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e4c5e27e-06fe-42a7-be0f-f3b27d148907 req-8af9cada-e8a3-4edb-ab90-4129a8347658 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-e4c5e27e-06fe-42a7-be0f-f3b27d148907 req-8af9cada-e8a3-4edb-ab90-4129a8347658 service nova] Creating event network-vif-unplugged:920aad6f-1d46-48d5-81eb-95ffbc851da0 for instance 2ca84990-b165-4d0b-a917-307cd8f96f28 on user Apr 14 03:06:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-e4c5e27e-06fe-42a7-be0f-f3b27d148907 req-8af9cada-e8a3-4edb-ab90-4129a8347658 service nova] Creating event network-vif-plugged:920aad6f-1d46-48d5-81eb-95ffbc851da0 for instance 2ca84990-b165-4d0b-a917-307cd8f96f28 on user Apr 14 03:06:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-e4c5e27e-06fe-42a7-be0f-f3b27d148907 req-8af9cada-e8a3-4edb-ab90-4129a8347658 service nova] Creating event network-vif-deleted:920aad6f-1d46-48d5-81eb-95ffbc851da0 for instance 2ca84990-b165-4d0b-a917-307cd8f96f28 on user Apr 14 03:06:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-e4c5e27e-06fe-42a7-be0f-f3b27d148907 req-8af9cada-e8a3-4edb-ab90-4129a8347658 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.036246 Apr 14 03:06:26 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 140/423] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:26 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0101533f-6f0d-4651-bb35-6f620ea5f7fc tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'create', calling method: .version_select at 0x7ff11a45c700>, body: {"keypair": {"name": "tempest-keypair-158606901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRt1vkGxga6d2lnbq6r7KuWDr3P9XxrdKyfybFxOJEVdZ9m8h/yMxKRYhp7IzJglBQvcA3Veeq6pJJUHOvucLytIWZV1lh6jcIrnJ6ba4rOplP1XVeraWzy0zv10BSYng=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:27 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-0101533f-6f0d-4651-bb35-6f620ea5f7fc tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Getting quotas for project 558bfd7e1d9049d396381de148b0c4a5. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:06:27 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-0101533f-6f0d-4651-bb35-6f620ea5f7fc tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Getting quotas for user d5e8150f1502427fb3148f20354d212e and project 558bfd7e1d9049d396381de148b0c4a5. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:06:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0101533f-6f0d-4651-bb35-6f620ea5f7fc tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058143 Apr 14 03:06:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 143/424] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:06:27 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-413600185", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d3496999-3ffc-4589-94fc-0795323a1d70"}], "security_groups": [{"name": "tempest-securitygroup--1823754687"}], "key_name": "tempest-keypair-158606901", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] validate_networks() for [('d3496999-3ffc-4589-94fc-0795323a1d70', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Getting quotas for project 558bfd7e1d9049d396381de148b0c4a5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Getting quotas for user d5e8150f1502427fb3148f20354d212e and project 558bfd7e1d9049d396381de148b0c4a5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:06:29 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:06:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7dc9e926-ee72-4771-a3ec-acd2e5f6fd79 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.974465 Apr 14 03:06:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 142/425] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:06:29 2023] POST /compute/v2.1/servers => generated 407 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:06:30 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b74c38e7-721d-44eb-bf33-f6762096988e tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:30 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-b74c38e7-721d-44eb-bf33-f6762096988e tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:30 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-b74c38e7-721d-44eb-bf33-f6762096988e tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:30 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b74c38e7-721d-44eb-bf33-f6762096988e tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531" status: 200 len: 1238 microversion: 2.1 time: 0.422051 Apr 14 03:06:30 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 141/426] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:30 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531 => generated 1238 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:06:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-b61f06ef-06f5-41ad-93e1-1d81689c38e9 req-55aabbd8-9e4d-43a7-b59d-67c7501fbf18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b61f06ef-06f5-41ad-93e1-1d81689c38e9 req-55aabbd8-9e4d-43a7-b59d-67c7501fbf18 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b61f06ef-06f5-41ad-93e1-1d81689c38e9 req-55aabbd8-9e4d-43a7-b59d-67c7501fbf18 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b61f06ef-06f5-41ad-93e1-1d81689c38e9 req-55aabbd8-9e4d-43a7-b59d-67c7501fbf18 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-b61f06ef-06f5-41ad-93e1-1d81689c38e9 req-55aabbd8-9e4d-43a7-b59d-67c7501fbf18 service nova] Creating event network-changed:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:06:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-b61f06ef-06f5-41ad-93e1-1d81689c38e9 req-55aabbd8-9e4d-43a7-b59d-67c7501fbf18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038304 Apr 14 03:06:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 144/427] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 8a826438-d96e-4e70-b50e-aca4be008394] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] HTTP exception thrown: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Request method failure captured: Apr 14 03:06:35 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394 HTTP/1.1 Apr 14 03:06:35 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:06:35 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:06:35 user devstack@n-api.service[61664]: Connection: close Apr 14 03:06:35 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:06:35 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:06:35 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:06:35 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:06:35 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMErwVvPJsjUJ3S0QPyBJwBGtPnN1VrL3KnPjbADURknqA0wkUZZ5eDBWtFcjFYFZZHeZil6ND7vyIhrBBYG50lpIyAGWg_8e4VgQYZfVgC3Jnm7MzkAyKb0p5axf2vM_aHXSvfx_x6W7PR7se8sYOcQ30uo0Jm_JeFuB_bek1E7GOY Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Project-Id: f021342634dd4f16bf2720533070154c Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f021342634dd4f16bf2720533070154c"}]}] Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Tenant: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Tenant-Id: f021342634dd4f16bf2720533070154c Apr 14 03:06:35 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:06:35 user devstack@n-api.service[61664]: X-User: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:06:35 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:06:35 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:06:35 user devstack@n-api.service[61664]: X-User-Id: 0dbce21e767a4a61b9213e38523d247e Apr 14 03:06:35 user devstack@n-api.service[61664]: X-User-Name: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:06:35 user devstack@n-api.service[61664]: method: > Apr 14 03:06:35 user devstack@n-api.service[61664]: exception: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:06:35 user devstack@n-api.service[61664]: action_args: {'id': '8a826438-d96e-4e70-b50e-aca4be008394'} Apr 14 03:06:35 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:06:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Returning 404 to user: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:06:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6d0656e5-c0e6-47bf-a089-4f918e895416 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394" status: 404 len: 111 microversion: 2.1 time: 0.033248 Apr 14 03:06:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 143/428] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:06:35 2023] DELETE /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 8a826438-d96e-4e70-b50e-aca4be008394] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] HTTP exception thrown: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Request method failure captured: Apr 14 03:06:35 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394 HTTP/1.1 Apr 14 03:06:35 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:06:35 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:06:35 user devstack@n-api.service[61662]: Connection: close Apr 14 03:06:35 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:06:35 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:06:35 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:06:35 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:06:35 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMErwVvPJsjUJ3S0QPyBJwBGtPnN1VrL3KnPjbADURknqA0wkUZZ5eDBWtFcjFYFZZHeZil6ND7vyIhrBBYG50lpIyAGWg_8e4VgQYZfVgC3Jnm7MzkAyKb0p5axf2vM_aHXSvfx_x6W7PR7se8sYOcQ30uo0Jm_JeFuB_bek1E7GOY Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Project-Id: f021342634dd4f16bf2720533070154c Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Project-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f021342634dd4f16bf2720533070154c"}]}] Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Tenant: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Tenant-Id: f021342634dd4f16bf2720533070154c Apr 14 03:06:35 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:06:35 user devstack@n-api.service[61662]: X-User: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:06:35 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:06:35 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:06:35 user devstack@n-api.service[61662]: X-User-Id: 0dbce21e767a4a61b9213e38523d247e Apr 14 03:06:35 user devstack@n-api.service[61662]: X-User-Name: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:06:35 user devstack@n-api.service[61662]: method: > Apr 14 03:06:35 user devstack@n-api.service[61662]: exception: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:06:35 user devstack@n-api.service[61662]: action_args: {'id': '8a826438-d96e-4e70-b50e-aca4be008394'} Apr 14 03:06:35 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. Apr 14 03:06:35 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Returning 404 to user: Instance 8a826438-d96e-4e70-b50e-aca4be008394 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:06:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a871472a-c9b9-4ee0-8fd1-4ab51043c0e4 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394" status: 404 len: 111 microversion: 2.1 time: 0.029434 Apr 14 03:06:35 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 142/429] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:35 2023] GET /compute/v2.1/servers/8a826438-d96e-4e70-b50e-aca4be008394 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-86c853e2-ce1d-4b91-883e-0f466f40fb20 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-86c853e2-ce1d-4b91-883e-0f466f40fb20 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86c853e2-ce1d-4b91-883e-0f466f40fb20 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86c853e2-ce1d-4b91-883e-0f466f40fb20 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86c853e2-ce1d-4b91-883e-0f466f40fb20 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86c853e2-ce1d-4b91-883e-0f466f40fb20 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86c853e2-ce1d-4b91-883e-0f466f40fb20 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86c853e2-ce1d-4b91-883e-0f466f40fb20 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-86c853e2-ce1d-4b91-883e-0f466f40fb20 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:06:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-86c853e2-ce1d-4b91-883e-0f466f40fb20 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b" status: 204 len: 0 microversion: 2.1 time: 0.156126 Apr 14 03:06:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 145/430] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:06:35 2023] DELETE /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-07d3c6eb-156f-4525-87a0-f8c24793ad05 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-07d3c6eb-156f-4525-87a0-f8c24793ad05 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-07d3c6eb-156f-4525-87a0-f8c24793ad05 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-07d3c6eb-156f-4525-87a0-f8c24793ad05 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-07d3c6eb-156f-4525-87a0-f8c24793ad05 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-07d3c6eb-156f-4525-87a0-f8c24793ad05 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-07d3c6eb-156f-4525-87a0-f8c24793ad05 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-07d3c6eb-156f-4525-87a0-f8c24793ad05 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:35 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-07d3c6eb-156f-4525-87a0-f8c24793ad05 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbce21e767a4a61b9213e38523d247e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021342634dd4f16bf2720533070154c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-07d3c6eb-156f-4525-87a0-f8c24793ad05 tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b" status: 200 len: 1499 microversion: 2.1 time: 0.258054 Apr 14 03:06:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 144/431] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:35 2023] GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b => generated 1499 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-4fe091bb-fbea-423b-ba6d-db52144f46b6 req-311e07fc-4249-4f66-a746-fe300be88eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb18db3-28b0-4886-a680-4c534d31cb6b", "name": "network-vif-unplugged", "status": "completed", "tag": "f52f4b73-b4c4-4bc7-a565-1239a13770f1"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-2518ee55-6991-4d7d-8cd2-64a5dc607033 req-b109a44b-fdb7-4e47-9967-2e4e0616c814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-plugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-4fe091bb-fbea-423b-ba6d-db52144f46b6 req-311e07fc-4249-4f66-a746-fe300be88eb7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-4fe091bb-fbea-423b-ba6d-db52144f46b6 req-311e07fc-4249-4f66-a746-fe300be88eb7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-4fe091bb-fbea-423b-ba6d-db52144f46b6 req-311e07fc-4249-4f66-a746-fe300be88eb7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2518ee55-6991-4d7d-8cd2-64a5dc607033 req-b109a44b-fdb7-4e47-9967-2e4e0616c814 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2518ee55-6991-4d7d-8cd2-64a5dc607033 req-b109a44b-fdb7-4e47-9967-2e4e0616c814 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2518ee55-6991-4d7d-8cd2-64a5dc607033 req-b109a44b-fdb7-4e47-9967-2e4e0616c814 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-4fe091bb-fbea-423b-ba6d-db52144f46b6 req-311e07fc-4249-4f66-a746-fe300be88eb7 service nova] Creating event network-vif-unplugged:f52f4b73-b4c4-4bc7-a565-1239a13770f1 for instance 1fb18db3-28b0-4886-a680-4c534d31cb6b on user Apr 14 03:06:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-2518ee55-6991-4d7d-8cd2-64a5dc607033 req-b109a44b-fdb7-4e47-9967-2e4e0616c814 service nova] Creating event network-vif-plugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:06:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-4fe091bb-fbea-423b-ba6d-db52144f46b6 req-311e07fc-4249-4f66-a746-fe300be88eb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034313 Apr 14 03:06:35 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 143/432] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-2518ee55-6991-4d7d-8cd2-64a5dc607033 req-b109a44b-fdb7-4e47-9967-2e4e0616c814 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033451 Apr 14 03:06:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 146/433] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-271acc11-8133-4b28-ab1d-de927e43316a req-9eb292c2-f824-45fa-b2b2-b23f458ac08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-plugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-2888c4fb-77c3-475f-82d6-9ba6a0efc436 req-3c52317d-048e-41bf-9fc5-7d6e705531b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb18db3-28b0-4886-a680-4c534d31cb6b", "name": "network-vif-plugged", "status": "completed", "tag": "f52f4b73-b4c4-4bc7-a565-1239a13770f1"}, {"server_uuid": "1fb18db3-28b0-4886-a680-4c534d31cb6b", "name": "network-vif-plugged", "status": "completed", "tag": "f52f4b73-b4c4-4bc7-a565-1239a13770f1"}, {"server_uuid": "1fb18db3-28b0-4886-a680-4c534d31cb6b", "name": "network-vif-plugged", "status": "completed", "tag": "f52f4b73-b4c4-4bc7-a565-1239a13770f1"}, {"server_uuid": "1fb18db3-28b0-4886-a680-4c534d31cb6b", "name": "network-vif-plugged", "status": "completed", "tag": "f52f4b73-b4c4-4bc7-a565-1239a13770f1"}, {"server_uuid": "1fb18db3-28b0-4886-a680-4c534d31cb6b", "name": "network-vif-deleted", "tag": "f52f4b73-b4c4-4bc7-a565-1239a13770f1"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-271acc11-8133-4b28-ab1d-de927e43316a req-9eb292c2-f824-45fa-b2b2-b23f458ac08f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-271acc11-8133-4b28-ab1d-de927e43316a req-9eb292c2-f824-45fa-b2b2-b23f458ac08f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-271acc11-8133-4b28-ab1d-de927e43316a req-9eb292c2-f824-45fa-b2b2-b23f458ac08f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-2888c4fb-77c3-475f-82d6-9ba6a0efc436 req-3c52317d-048e-41bf-9fc5-7d6e705531b7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-2888c4fb-77c3-475f-82d6-9ba6a0efc436 req-3c52317d-048e-41bf-9fc5-7d6e705531b7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-2888c4fb-77c3-475f-82d6-9ba6a0efc436 req-3c52317d-048e-41bf-9fc5-7d6e705531b7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-271acc11-8133-4b28-ab1d-de927e43316a req-9eb292c2-f824-45fa-b2b2-b23f458ac08f service nova] Creating event network-vif-plugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:06:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-2888c4fb-77c3-475f-82d6-9ba6a0efc436 req-3c52317d-048e-41bf-9fc5-7d6e705531b7 service nova] Creating event network-vif-plugged:f52f4b73-b4c4-4bc7-a565-1239a13770f1 for instance 1fb18db3-28b0-4886-a680-4c534d31cb6b on user Apr 14 03:06:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-2888c4fb-77c3-475f-82d6-9ba6a0efc436 req-3c52317d-048e-41bf-9fc5-7d6e705531b7 service nova] Creating event network-vif-plugged:f52f4b73-b4c4-4bc7-a565-1239a13770f1 for instance 1fb18db3-28b0-4886-a680-4c534d31cb6b on user Apr 14 03:06:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-271acc11-8133-4b28-ab1d-de927e43316a req-9eb292c2-f824-45fa-b2b2-b23f458ac08f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 Apr 14 03:06:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-2888c4fb-77c3-475f-82d6-9ba6a0efc436 req-3c52317d-048e-41bf-9fc5-7d6e705531b7 service nova] Creating event network-vif-plugged:f52f4b73-b4c4-4bc7-a565-1239a13770f1 for instance 1fb18db3-28b0-4886-a680-4c534d31cb6b on user Apr 14 03:06:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 145/434] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-2888c4fb-77c3-475f-82d6-9ba6a0efc436 req-3c52317d-048e-41bf-9fc5-7d6e705531b7 service nova] Creating event network-vif-plugged:f52f4b73-b4c4-4bc7-a565-1239a13770f1 for instance 1fb18db3-28b0-4886-a680-4c534d31cb6b on user Apr 14 03:06:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-2888c4fb-77c3-475f-82d6-9ba6a0efc436 req-3c52317d-048e-41bf-9fc5-7d6e705531b7 service nova] Creating event network-vif-deleted:f52f4b73-b4c4-4bc7-a565-1239a13770f1 for instance 1fb18db3-28b0-4886-a680-4c534d31cb6b on user Apr 14 03:06:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-2888c4fb-77c3-475f-82d6-9ba6a0efc436 req-3c52317d-048e-41bf-9fc5-7d6e705531b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.037189 Apr 14 03:06:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 144/435] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:39 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-96f2a2d0-bf81-4565-9fef-f3a192cc482a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-96f2a2d0-bf81-4565-9fef-f3a192cc482a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-96f2a2d0-bf81-4565-9fef-f3a192cc482a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-96f2a2d0-bf81-4565-9fef-f3a192cc482a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-96f2a2d0-bf81-4565-9fef-f3a192cc482a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-96f2a2d0-bf81-4565-9fef-f3a192cc482a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-96f2a2d0-bf81-4565-9fef-f3a192cc482a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-96f2a2d0-bf81-4565-9fef-f3a192cc482a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-96f2a2d0-bf81-4565-9fef-f3a192cc482a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-96f2a2d0-bf81-4565-9fef-f3a192cc482a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1675 microversion: 2.1 time: 0.149692 Apr 14 03:06:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 147/436] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:39 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:06:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9df6022a-be13-4574-a908-5ad778bc77e7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44f3cbc9-fd81-4185-aa74-0896739af983"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9df6022a-be13-4574-a908-5ad778bc77e7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9df6022a-be13-4574-a908-5ad778bc77e7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9df6022a-be13-4574-a908-5ad778bc77e7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9df6022a-be13-4574-a908-5ad778bc77e7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9df6022a-be13-4574-a908-5ad778bc77e7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9df6022a-be13-4574-a908-5ad778bc77e7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9df6022a-be13-4574-a908-5ad778bc77e7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9df6022a-be13-4574-a908-5ad778bc77e7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394499 Apr 14 03:06:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 146/437] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:06:39 2023] POST /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:44 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-1ca32933-dcb1-4409-80ff-3c088345dd36 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Action: 'create', calling method: .version_select at 0x7ff11a4b70a0>, body: {"keypair": {"name": "tempest-keypair-125552723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcISVbpMfujGhoh7rbfetW/zcM/03NdmV8Cb0fw6DH3n7dkVxNJiOWLbbCwDZHTif2tW1OoRH8+60pwgTl4zPLJddaDbYKFEZIg+5EIzppcSOENhjHsGzD18LuB1mTHTg=="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:44 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:44 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-1ca32933-dcb1-4409-80ff-3c088345dd36 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Getting quotas for project f1d531e7f7004ebaa529cb60de3849e7. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:06:44 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-1ca32933-dcb1-4409-80ff-3c088345dd36 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Getting quotas for user 5a311491e2924c49b01fd42458ec2fc2 and project f1d531e7f7004ebaa529cb60de3849e7. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:06:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-1ca32933-dcb1-4409-80ff-3c088345dd36 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.047046 Apr 14 03:06:44 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 145/438] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 03:06:44 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 03:06:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-875179344", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "1fac4ba0-7ffa-4c1e-b03e-4f6b4da1acc0"}, {"port": "dbeb1c70-267b-4fde-b1a5-0e3567a11489", "tag": "port-1"}, {"port": "0a6ecbf1-8127-469a-92cc-5b4673e3db51", "tag": "port-2"}, {"uuid": "896608cc-3794-4116-8493-dc55728a1840", "tag": "net-1"}, {"uuid": "896608cc-3794-4116-8493-dc55728a1840"}, {"uuid": "865279bb-ea51-408b-9323-2dfeddec5e82", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "865279bb-ea51-408b-9323-2dfeddec5e82", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d7ac81e3-c104-4bb3-ada5-ecd6969601f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f9476602-ab81-47c8-aa31-ecc8e3c672ee", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e178f132-e302-4ee5-8ca6-45972e24754a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1043582597"}], "key_name": "tempest-keypair-125552723", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:46 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:46 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] validate_networks() for [('1fac4ba0-7ffa-4c1e-b03e-4f6b4da1acc0', None, None, None, None, None), (None, None, 'dbeb1c70-267b-4fde-b1a5-0e3567a11489', None, None, None), (None, None, '0a6ecbf1-8127-469a-92cc-5b4673e3db51', None, None, None), ('896608cc-3794-4116-8493-dc55728a1840', None, None, None, None, None), ('896608cc-3794-4116-8493-dc55728a1840', None, None, None, None, None), ('865279bb-ea51-408b-9323-2dfeddec5e82', '10.2.2.100', None, None, None, None), ('865279bb-ea51-408b-9323-2dfeddec5e82', '10.2.2.200', None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Old instance type m1.nano, new instance type m1.micro {{(pid=61664) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for user 7dea23743ba945c4a9d539b8e277c653 and project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:06:47 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:06:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/action" status: 202 len: 0 microversion: 2.1 time: 0.284670 Apr 14 03:06:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 147/439] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:06:47 2023] POST /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:06:48 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:48 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-11409ff9-ed3f-4ed8-8a7d-301d88aee296 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:48 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-11409ff9-ed3f-4ed8-8a7d-301d88aee296 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-11409ff9-ed3f-4ed8-8a7d-301d88aee296 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-11409ff9-ed3f-4ed8-8a7d-301d88aee296 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-11409ff9-ed3f-4ed8-8a7d-301d88aee296 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-11409ff9-ed3f-4ed8-8a7d-301d88aee296 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-11409ff9-ed3f-4ed8-8a7d-301d88aee296 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-11409ff9-ed3f-4ed8-8a7d-301d88aee296 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:48 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-11409ff9-ed3f-4ed8-8a7d-301d88aee296 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:48 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-11409ff9-ed3f-4ed8-8a7d-301d88aee296 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1730 microversion: 2.1 time: 0.231948 Apr 14 03:06:48 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 146/440] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:06:48 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Getting quotas for project f1d531e7f7004ebaa529cb60de3849e7. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Getting quotas for user 5a311491e2924c49b01fd42458ec2fc2 and project f1d531e7f7004ebaa529cb60de3849e7. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:06:48 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d7ac81e3-c104-4bb3-ada5-ecd6969601f0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f9476602-ab81-47c8-aa31-ecc8e3c672ee',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e178f132-e302-4ee5-8ca6-45972e24754a',volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:06:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 2.850745 Apr 14 03:06:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 148/441] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 03:06:46 2023] POST /compute/v2.1/servers => generated 404 bytes in 2852 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 03:06:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a22874ba-9981-4523-85c1-815cd2f2e92e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a22874ba-9981-4523-85c1-815cd2f2e92e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-6db44f17-0bd9-4355-9862-ddb738e88474 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1847230332"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:49 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-6db44f17-0bd9-4355-9862-ddb738e88474 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6db44f17-0bd9-4355-9862-ddb738e88474 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6db44f17-0bd9-4355-9862-ddb738e88474 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6db44f17-0bd9-4355-9862-ddb738e88474 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6db44f17-0bd9-4355-9862-ddb738e88474 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6db44f17-0bd9-4355-9862-ddb738e88474 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6db44f17-0bd9-4355-9862-ddb738e88474 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:49 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a22874ba-9981-4523-85c1-815cd2f2e92e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:49 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a22874ba-9981-4523-85c1-815cd2f2e92e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:49 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a22874ba-9981-4523-85c1-815cd2f2e92e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a22874ba-9981-4523-85c1-815cd2f2e92e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93" status: 200 len: 1278 microversion: 2.42 time: 0.077576 Apr 14 03:06:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 148/442] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:06:49 2023] GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 => generated 1278 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:06:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-6db44f17-0bd9-4355-9862-ddb738e88474 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e/action" status: 202 len: 52 microversion: 2.87 time: 1.137996 Apr 14 03:06:50 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 147/443] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 03:06:49 2023] POST /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e/action => generated 52 bytes in 1140 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 03:06:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a6a94f1b-f13f-44c2-bffa-e22a370aed06 req-6ea2820d-649c-4790-9229-3df212f79c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-unplugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a6a94f1b-f13f-44c2-bffa-e22a370aed06 req-6ea2820d-649c-4790-9229-3df212f79c16 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a6a94f1b-f13f-44c2-bffa-e22a370aed06 req-6ea2820d-649c-4790-9229-3df212f79c16 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a6a94f1b-f13f-44c2-bffa-e22a370aed06 req-6ea2820d-649c-4790-9229-3df212f79c16 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a6a94f1b-f13f-44c2-bffa-e22a370aed06 req-6ea2820d-649c-4790-9229-3df212f79c16 service nova] Creating event network-vif-unplugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:06:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [req-a6a94f1b-f13f-44c2-bffa-e22a370aed06 req-6ea2820d-649c-4790-9229-3df212f79c16 service nova] Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61663) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:06:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a6a94f1b-f13f-44c2-bffa-e22a370aed06 req-6ea2820d-649c-4790-9229-3df212f79c16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041250 Apr 14 03:06:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 149/444] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b592fbf6-ebcc-4145-98fd-73252ef47058 req-bdf41638-205b-4c26-8cc7-358dc5e74b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}, {"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}, {"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}, {"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-unplugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b592fbf6-ebcc-4145-98fd-73252ef47058 req-bdf41638-205b-4c26-8cc7-358dc5e74b42 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b592fbf6-ebcc-4145-98fd-73252ef47058 req-bdf41638-205b-4c26-8cc7-358dc5e74b42 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b592fbf6-ebcc-4145-98fd-73252ef47058 req-bdf41638-205b-4c26-8cc7-358dc5e74b42 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b592fbf6-ebcc-4145-98fd-73252ef47058 req-bdf41638-205b-4c26-8cc7-358dc5e74b42 service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:06:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b592fbf6-ebcc-4145-98fd-73252ef47058 req-bdf41638-205b-4c26-8cc7-358dc5e74b42 service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:06:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b592fbf6-ebcc-4145-98fd-73252ef47058 req-bdf41638-205b-4c26-8cc7-358dc5e74b42 service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:06:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b592fbf6-ebcc-4145-98fd-73252ef47058 req-bdf41638-205b-4c26-8cc7-358dc5e74b42 service nova] Creating event network-vif-unplugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:06:53 user devstack@n-api.service[61664]: DEBUG nova.compute.api [req-b592fbf6-ebcc-4145-98fd-73252ef47058 req-bdf41638-205b-4c26-8cc7-358dc5e74b42 service nova] Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61664) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:06:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b592fbf6-ebcc-4145-98fd-73252ef47058 req-bdf41638-205b-4c26-8cc7-358dc5e74b42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.044326 Apr 14 03:06:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 149/445] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:53 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-f5fdcc89-78e5-4f74-aefb-8eda45e358ca req-7eb22812-5692-4b30-bdd3-5f0e1f4199ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:55 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f5fdcc89-78e5-4f74-aefb-8eda45e358ca req-7eb22812-5692-4b30-bdd3-5f0e1f4199ed service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f5fdcc89-78e5-4f74-aefb-8eda45e358ca req-7eb22812-5692-4b30-bdd3-5f0e1f4199ed service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f5fdcc89-78e5-4f74-aefb-8eda45e358ca req-7eb22812-5692-4b30-bdd3-5f0e1f4199ed service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-f5fdcc89-78e5-4f74-aefb-8eda45e358ca req-7eb22812-5692-4b30-bdd3-5f0e1f4199ed service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:06:55 user devstack@n-api.service[61662]: DEBUG nova.compute.api [req-f5fdcc89-78e5-4f74-aefb-8eda45e358ca req-7eb22812-5692-4b30-bdd3-5f0e1f4199ed service nova] Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61662) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:06:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-f5fdcc89-78e5-4f74-aefb-8eda45e358ca req-7eb22812-5692-4b30-bdd3-5f0e1f4199ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064834 Apr 14 03:06:55 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 148/446] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:56 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:06:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-031d8c76-eed6-4ac6-a4b2-1d910b366e65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e" status: 200 len: 1690 microversion: 2.87 time: 0.206478 Apr 14 03:06:56 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 150/447] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:06:56 2023] GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e => generated 1690 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:06:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-dbb10713-e852-41fc-ac92-7aebdacebf2e req-1b119041-a34e-45db-afe2-06b100562793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "tag": "2e49423b-86d6-4b5a-b9cf-321ee37937c3"}, {"name": "network-changed", "server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "tag": "dbeb1c70-267b-4fde-b1a5-0e3567a11489"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dbb10713-e852-41fc-ac92-7aebdacebf2e req-1b119041-a34e-45db-afe2-06b100562793 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dbb10713-e852-41fc-ac92-7aebdacebf2e req-1b119041-a34e-45db-afe2-06b100562793 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dbb10713-e852-41fc-ac92-7aebdacebf2e req-1b119041-a34e-45db-afe2-06b100562793 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-dbb10713-e852-41fc-ac92-7aebdacebf2e req-1b119041-a34e-45db-afe2-06b100562793 service nova] Creating event network-changed:2e49423b-86d6-4b5a-b9cf-321ee37937c3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:06:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-dbb10713-e852-41fc-ac92-7aebdacebf2e req-1b119041-a34e-45db-afe2-06b100562793 service nova] Creating event network-changed:dbeb1c70-267b-4fde-b1a5-0e3567a11489 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:06:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-dbb10713-e852-41fc-ac92-7aebdacebf2e req-1b119041-a34e-45db-afe2-06b100562793 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051276 Apr 14 03:06:57 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 150/448] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:57 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:06:59 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-db6ed4a8-fc90-442d-85ca-83c3ec2ae6be req-08cb294d-56ae-4dea-bbed-edfa44a81172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "tag": "0a6ecbf1-8127-469a-92cc-5b4673e3db51"}, {"name": "network-changed", "server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "tag": "98ba28ec-b77c-4a23-b003-a4d29371cf95"}, {"name": "network-changed", "server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "tag": "dd090320-de86-40c8-bafb-515fa9c628e3"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:06:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-db6ed4a8-fc90-442d-85ca-83c3ec2ae6be req-08cb294d-56ae-4dea-bbed-edfa44a81172 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:06:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-db6ed4a8-fc90-442d-85ca-83c3ec2ae6be req-08cb294d-56ae-4dea-bbed-edfa44a81172 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:06:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-db6ed4a8-fc90-442d-85ca-83c3ec2ae6be req-08cb294d-56ae-4dea-bbed-edfa44a81172 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:06:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-db6ed4a8-fc90-442d-85ca-83c3ec2ae6be req-08cb294d-56ae-4dea-bbed-edfa44a81172 service nova] Creating event network-changed:0a6ecbf1-8127-469a-92cc-5b4673e3db51 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:06:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-db6ed4a8-fc90-442d-85ca-83c3ec2ae6be req-08cb294d-56ae-4dea-bbed-edfa44a81172 service nova] Creating event network-changed:98ba28ec-b77c-4a23-b003-a4d29371cf95 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:06:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-db6ed4a8-fc90-442d-85ca-83c3ec2ae6be req-08cb294d-56ae-4dea-bbed-edfa44a81172 service nova] Creating event network-changed:dd090320-de86-40c8-bafb-515fa9c628e3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:06:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-db6ed4a8-fc90-442d-85ca-83c3ec2ae6be req-08cb294d-56ae-4dea-bbed-edfa44a81172 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.039430 Apr 14 03:06:59 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 149/449] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:06:59 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a69e63e2-7c93-4910-8449-5f8eac31fd39 req-c7b9345f-6ade-4278-88eb-b481a4dea228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "tag": "6691f178-7199-44c1-9dd7-049cf205185b"}, {"name": "network-changed", "server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "tag": "093349f3-a544-487d-9927-f75c63ac2e9c"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:01 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:01 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a69e63e2-7c93-4910-8449-5f8eac31fd39 req-c7b9345f-6ade-4278-88eb-b481a4dea228 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a69e63e2-7c93-4910-8449-5f8eac31fd39 req-c7b9345f-6ade-4278-88eb-b481a4dea228 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a69e63e2-7c93-4910-8449-5f8eac31fd39 req-c7b9345f-6ade-4278-88eb-b481a4dea228 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a69e63e2-7c93-4910-8449-5f8eac31fd39 req-c7b9345f-6ade-4278-88eb-b481a4dea228 service nova] Creating event network-changed:6691f178-7199-44c1-9dd7-049cf205185b for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a69e63e2-7c93-4910-8449-5f8eac31fd39 req-c7b9345f-6ade-4278-88eb-b481a4dea228 service nova] Creating event network-changed:093349f3-a544-487d-9927-f75c63ac2e9c for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a69e63e2-7c93-4910-8449-5f8eac31fd39 req-c7b9345f-6ade-4278-88eb-b481a4dea228 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047272 Apr 14 03:07:01 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 151/450] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:01 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-dbb81b53-87f7-47a0-97ed-ef7ddb69e3eb req-4cf429fd-895f-4e6c-ba57-a5986730cb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:04 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:04 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dbb81b53-87f7-47a0-97ed-ef7ddb69e3eb req-4cf429fd-895f-4e6c-ba57-a5986730cb7b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dbb81b53-87f7-47a0-97ed-ef7ddb69e3eb req-4cf429fd-895f-4e6c-ba57-a5986730cb7b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dbb81b53-87f7-47a0-97ed-ef7ddb69e3eb req-4cf429fd-895f-4e6c-ba57-a5986730cb7b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-dbb81b53-87f7-47a0-97ed-ef7ddb69e3eb req-4cf429fd-895f-4e6c-ba57-a5986730cb7b service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:07:04 user devstack@n-api.service[61664]: DEBUG nova.compute.api [req-dbb81b53-87f7-47a0-97ed-ef7ddb69e3eb req-4cf429fd-895f-4e6c-ba57-a5986730cb7b service nova] Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61664) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:07:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-dbb81b53-87f7-47a0-97ed-ef7ddb69e3eb req-4cf429fd-895f-4e6c-ba57-a5986730cb7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069839 Apr 14 03:07:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 151/451] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:04 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:04 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 62cad020-0344-4e4e-add9-e5bc6175adbb] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:04 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:07:04 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb HTTP/1.1 Apr 14 03:07:04 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:07:04 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:07:04 user devstack@n-api.service[61662]: Connection: close Apr 14 03:07:04 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:07:04 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:07:04 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:07:04 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:07:04 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:04 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:04 user devstack@n-api.service[61662]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:04 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:07:04 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:07:04 user devstack@n-api.service[61662]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:07:04 user devstack@n-api.service[61662]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:04 user devstack@n-api.service[61662]: method: > Apr 14 03:07:04 user devstack@n-api.service[61662]: exception: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:04 user devstack@n-api.service[61662]: action_args: {'id': '62cad020-0344-4e4e-add9-e5bc6175adbb'} Apr 14 03:07:04 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:04 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:04 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:07:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-32f321b5-628d-47ab-83ee-e37e4fabf448 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb" status: 404 len: 111 microversion: 2.1 time: 0.037278 Apr 14 03:07:04 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 150/452] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:07:04 2023] GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:07:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d276b39b-d708-4224-a9e7-f859afdd6033 req-c95e742b-8346-4376-a48e-aced4446bad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d276b39b-d708-4224-a9e7-f859afdd6033 req-c95e742b-8346-4376-a48e-aced4446bad5 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d276b39b-d708-4224-a9e7-f859afdd6033 req-c95e742b-8346-4376-a48e-aced4446bad5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d276b39b-d708-4224-a9e7-f859afdd6033 req-c95e742b-8346-4376-a48e-aced4446bad5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d276b39b-d708-4224-a9e7-f859afdd6033 req-c95e742b-8346-4376-a48e-aced4446bad5 service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:07:06 user devstack@n-api.service[61663]: DEBUG nova.compute.api [req-d276b39b-d708-4224-a9e7-f859afdd6033 req-c95e742b-8346-4376-a48e-aced4446bad5 service nova] Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61663) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:07:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d276b39b-d708-4224-a9e7-f859afdd6033 req-c95e742b-8346-4376-a48e-aced4446bad5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130883 Apr 14 03:07:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 152/453] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c672aa91-49fa-4708-ae02-e93e69b845f4 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:08 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c672aa91-49fa-4708-ae02-e93e69b845f4 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c672aa91-49fa-4708-ae02-e93e69b845f4 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c672aa91-49fa-4708-ae02-e93e69b845f4 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c672aa91-49fa-4708-ae02-e93e69b845f4 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c672aa91-49fa-4708-ae02-e93e69b845f4 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c672aa91-49fa-4708-ae02-e93e69b845f4 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c672aa91-49fa-4708-ae02-e93e69b845f4 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:08 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c672aa91-49fa-4708-ae02-e93e69b845f4 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:07:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c672aa91-49fa-4708-ae02-e93e69b845f4 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef" status: 204 len: 0 microversion: 2.1 time: 0.110601 Apr 14 03:07:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 152/454] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:07:08 2023] DELETE /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:07:08 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-2fe74085-a1ae-45e6-b9a7-f997020347af tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:08 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-2fe74085-a1ae-45e6-b9a7-f997020347af tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2fe74085-a1ae-45e6-b9a7-f997020347af tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2fe74085-a1ae-45e6-b9a7-f997020347af tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2fe74085-a1ae-45e6-b9a7-f997020347af tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2fe74085-a1ae-45e6-b9a7-f997020347af tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2fe74085-a1ae-45e6-b9a7-f997020347af tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2fe74085-a1ae-45e6-b9a7-f997020347af tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:08 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-2fe74085-a1ae-45e6-b9a7-f997020347af tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:08 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-2fe74085-a1ae-45e6-b9a7-f997020347af tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef" status: 200 len: 1400 microversion: 2.1 time: 0.158006 Apr 14 03:07:08 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 151/455] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:07:08 2023] GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef => generated 1400 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:07:08 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-fb719e03-5687-4b4f-977a-cf406fb0037f req-f74864be-1e0d-48ab-909c-307ff474523a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f970adb1-fe1b-4b58-83aa-45207a6211ef", "name": "network-vif-unplugged", "status": "completed", "tag": "e51353cf-a5e9-41e4-9b6e-4a022984af76"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-fb719e03-5687-4b4f-977a-cf406fb0037f req-f74864be-1e0d-48ab-909c-307ff474523a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-fb719e03-5687-4b4f-977a-cf406fb0037f req-f74864be-1e0d-48ab-909c-307ff474523a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-fb719e03-5687-4b4f-977a-cf406fb0037f req-f74864be-1e0d-48ab-909c-307ff474523a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-fb719e03-5687-4b4f-977a-cf406fb0037f req-f74864be-1e0d-48ab-909c-307ff474523a service nova] Creating event network-vif-unplugged:e51353cf-a5e9-41e4-9b6e-4a022984af76 for instance f970adb1-fe1b-4b58-83aa-45207a6211ef on user Apr 14 03:07:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-fb719e03-5687-4b4f-977a-cf406fb0037f req-f74864be-1e0d-48ab-909c-307ff474523a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063130 Apr 14 03:07:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 153/456] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:10 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-2f0aafd2-0775-4028-9cb2-53fae0f903a8 req-6521c031-9435-42db-9e45-3c862e836852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f970adb1-fe1b-4b58-83aa-45207a6211ef", "name": "network-vif-plugged", "status": "completed", "tag": "e51353cf-a5e9-41e4-9b6e-4a022984af76"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2f0aafd2-0775-4028-9cb2-53fae0f903a8 req-6521c031-9435-42db-9e45-3c862e836852 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2f0aafd2-0775-4028-9cb2-53fae0f903a8 req-6521c031-9435-42db-9e45-3c862e836852 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2f0aafd2-0775-4028-9cb2-53fae0f903a8 req-6521c031-9435-42db-9e45-3c862e836852 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-2f0aafd2-0775-4028-9cb2-53fae0f903a8 req-6521c031-9435-42db-9e45-3c862e836852 service nova] Creating event network-vif-plugged:e51353cf-a5e9-41e4-9b6e-4a022984af76 for instance f970adb1-fe1b-4b58-83aa-45207a6211ef on user Apr 14 03:07:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-2f0aafd2-0775-4028-9cb2-53fae0f903a8 req-6521c031-9435-42db-9e45-3c862e836852 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063165 Apr 14 03:07:10 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 153/457] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:10 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-5712b1dd-16c6-4036-aed2-b47d9e109a7a req-8ca444cf-3aa6-4bf7-adea-09cf4588d09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f970adb1-fe1b-4b58-83aa-45207a6211ef", "name": "network-vif-deleted", "tag": "e51353cf-a5e9-41e4-9b6e-4a022984af76"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5712b1dd-16c6-4036-aed2-b47d9e109a7a req-8ca444cf-3aa6-4bf7-adea-09cf4588d09b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5712b1dd-16c6-4036-aed2-b47d9e109a7a req-8ca444cf-3aa6-4bf7-adea-09cf4588d09b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5712b1dd-16c6-4036-aed2-b47d9e109a7a req-8ca444cf-3aa6-4bf7-adea-09cf4588d09b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-5712b1dd-16c6-4036-aed2-b47d9e109a7a req-8ca444cf-3aa6-4bf7-adea-09cf4588d09b service nova] Creating event network-vif-deleted:e51353cf-a5e9-41e4-9b6e-4a022984af76 for instance f970adb1-fe1b-4b58-83aa-45207a6211ef on user Apr 14 03:07:10 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-5712b1dd-16c6-4036-aed2-b47d9e109a7a req-8ca444cf-3aa6-4bf7-adea-09cf4588d09b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030256 Apr 14 03:07:10 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 152/458] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d937b6c8-ab63-4a0e-aa67-f355febe5c4e req-6a603496-874d-4ddb-9680-2e43c26de1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "2e49423b-86d6-4b5a-b9cf-321ee37937c3"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d937b6c8-ab63-4a0e-aa67-f355febe5c4e req-6a603496-874d-4ddb-9680-2e43c26de1ca service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d937b6c8-ab63-4a0e-aa67-f355febe5c4e req-6a603496-874d-4ddb-9680-2e43c26de1ca service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d937b6c8-ab63-4a0e-aa67-f355febe5c4e req-6a603496-874d-4ddb-9680-2e43c26de1ca service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d937b6c8-ab63-4a0e-aa67-f355febe5c4e req-6a603496-874d-4ddb-9680-2e43c26de1ca service nova] Creating event network-vif-plugged:2e49423b-86d6-4b5a-b9cf-321ee37937c3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d937b6c8-ab63-4a0e-aa67-f355febe5c4e req-6a603496-874d-4ddb-9680-2e43c26de1ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087785 Apr 14 03:07:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 154/459] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:07:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-aca1d7c3-6435-48a7-a04d-a7c61554b458 req-2ba18f84-cd99-4c88-93f6-2add9678ef2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "0a6ecbf1-8127-469a-92cc-5b4673e3db51"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-aca1d7c3-6435-48a7-a04d-a7c61554b458 req-2ba18f84-cd99-4c88-93f6-2add9678ef2d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-aca1d7c3-6435-48a7-a04d-a7c61554b458 req-2ba18f84-cd99-4c88-93f6-2add9678ef2d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-aca1d7c3-6435-48a7-a04d-a7c61554b458 req-2ba18f84-cd99-4c88-93f6-2add9678ef2d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-aca1d7c3-6435-48a7-a04d-a7c61554b458 req-2ba18f84-cd99-4c88-93f6-2add9678ef2d service nova] Creating event network-vif-plugged:0a6ecbf1-8127-469a-92cc-5b4673e3db51 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-aca1d7c3-6435-48a7-a04d-a7c61554b458 req-2ba18f84-cd99-4c88-93f6-2add9678ef2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096949 Apr 14 03:07:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 154/460] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-40d08f95-4f27-441d-9de1-2efd0b80342f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:14 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-40d08f95-4f27-441d-9de1-2efd0b80342f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-40d08f95-4f27-441d-9de1-2efd0b80342f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-40d08f95-4f27-441d-9de1-2efd0b80342f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-40d08f95-4f27-441d-9de1-2efd0b80342f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-40d08f95-4f27-441d-9de1-2efd0b80342f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-40d08f95-4f27-441d-9de1-2efd0b80342f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-40d08f95-4f27-441d-9de1-2efd0b80342f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-40d08f95-4f27-441d-9de1-2efd0b80342f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.150648 Apr 14 03:07:14 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 153/461] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 03:07:14 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-interface => generated 283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:07:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:14 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] [instance: 2ca84990-b165-4d0b-a917-307cd8f96f28] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] HTTP exception thrown: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 could not be found. Apr 14 03:07:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Request method failure captured: Apr 14 03:07:14 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28 HTTP/1.1 Apr 14 03:07:14 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:07:14 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:07:14 user devstack@n-api.service[61663]: Connection: close Apr 14 03:07:14 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:07:14 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:07:14 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:07:14 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:07:14 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMF-cxMM8Zg-1HxO7Hg0COB4TfXRsitd3vZgCa-KlJQ7oJuhqw9Yw9ibckvkMm6bFnKJcm9F1ma5LzyLyjIxLV8y7ooOqb7M12lHeoS1kYyftcZARhZpQFpCG5IBJz1rQZChnLNsrXGpr5IelSiJktoJlRrKb03IeWUcmwwjBy0NPps Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Project-Id: 6371b4c05df843da9b134e12994c1d7a Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestStampPattern-323884970 Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6371b4c05df843da9b134e12994c1d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6371b4c05df843da9b134e12994c1d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6371b4c05df843da9b134e12994c1d7a"}]}] Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Tenant: tempest-TestStampPattern-323884970 Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Tenant-Id: 6371b4c05df843da9b134e12994c1d7a Apr 14 03:07:14 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestStampPattern-323884970 Apr 14 03:07:14 user devstack@n-api.service[61663]: X-User: tempest-TestStampPattern-323884970-project-member Apr 14 03:07:14 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:07:14 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:07:14 user devstack@n-api.service[61663]: X-User-Id: 337e2d8118324215b5a0baa36a5895b0 Apr 14 03:07:14 user devstack@n-api.service[61663]: X-User-Name: tempest-TestStampPattern-323884970-project-member Apr 14 03:07:14 user devstack@n-api.service[61663]: method: > Apr 14 03:07:14 user devstack@n-api.service[61663]: exception: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 could not be found. Apr 14 03:07:14 user devstack@n-api.service[61663]: action_args: {'id': '2ca84990-b165-4d0b-a917-307cd8f96f28'} Apr 14 03:07:14 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 could not be found. Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 could not be found. Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 could not be found. Apr 14 03:07:14 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Returning 404 to user: Instance 2ca84990-b165-4d0b-a917-307cd8f96f28 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:07:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c1fe3fc0-5844-49f7-9d50-a68323229381 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28" status: 404 len: 111 microversion: 2.1 time: 0.046378 Apr 14 03:07:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 155/462] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:07:14 2023] GET /compute/v2.1/servers/2ca84990-b165-4d0b-a917-307cd8f96f28 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:07:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "2e49423b-86d6-4b5a-b9cf-321ee37937c3"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "dbeb1c70-267b-4fde-b1a5-0e3567a11489"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "dbeb1c70-267b-4fde-b1a5-0e3567a11489"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "98ba28ec-b77c-4a23-b003-a4d29371cf95"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "98ba28ec-b77c-4a23-b003-a4d29371cf95"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "6691f178-7199-44c1-9dd7-049cf205185b"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "6691f178-7199-44c1-9dd7-049cf205185b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Creating event network-vif-plugged:2e49423b-86d6-4b5a-b9cf-321ee37937c3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Creating event network-vif-plugged:dbeb1c70-267b-4fde-b1a5-0e3567a11489 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Creating event network-vif-plugged:dbeb1c70-267b-4fde-b1a5-0e3567a11489 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Creating event network-vif-plugged:98ba28ec-b77c-4a23-b003-a4d29371cf95 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Creating event network-vif-plugged:98ba28ec-b77c-4a23-b003-a4d29371cf95 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Creating event network-vif-plugged:6691f178-7199-44c1-9dd7-049cf205185b for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] Creating event network-vif-plugged:6691f178-7199-44c1-9dd7-049cf205185b for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-1a2276e9-0449-4130-90ba-0aca0d59e42a req-3ebf4823-245d-4517-8407-685a8d79896e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.051476 Apr 14 03:07:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 155/463] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 03:07:14 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:07:15 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-f04392ca-acf2-4a89-bb2b-ffb60a72b983 req-2aba8e91-9855-4382-9b77-8cdf9929bb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "0a6ecbf1-8127-469a-92cc-5b4673e3db51"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "dd090320-de86-40c8-bafb-515fa9c628e3"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "dd090320-de86-40c8-bafb-515fa9c628e3"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:15 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f04392ca-acf2-4a89-bb2b-ffb60a72b983 req-2aba8e91-9855-4382-9b77-8cdf9929bb5d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f04392ca-acf2-4a89-bb2b-ffb60a72b983 req-2aba8e91-9855-4382-9b77-8cdf9929bb5d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f04392ca-acf2-4a89-bb2b-ffb60a72b983 req-2aba8e91-9855-4382-9b77-8cdf9929bb5d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-f04392ca-acf2-4a89-bb2b-ffb60a72b983 req-2aba8e91-9855-4382-9b77-8cdf9929bb5d service nova] Creating event network-vif-plugged:0a6ecbf1-8127-469a-92cc-5b4673e3db51 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-f04392ca-acf2-4a89-bb2b-ffb60a72b983 req-2aba8e91-9855-4382-9b77-8cdf9929bb5d service nova] Creating event network-vif-plugged:dd090320-de86-40c8-bafb-515fa9c628e3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-f04392ca-acf2-4a89-bb2b-ffb60a72b983 req-2aba8e91-9855-4382-9b77-8cdf9929bb5d service nova] Creating event network-vif-plugged:dd090320-de86-40c8-bafb-515fa9c628e3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-f04392ca-acf2-4a89-bb2b-ffb60a72b983 req-2aba8e91-9855-4382-9b77-8cdf9929bb5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037746 Apr 14 03:07:15 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 154/464] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:15 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:07:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3c71f951-58fb-4db0-a818-ffe2a0182e7c req-da48924e-ccdd-4aab-a3cd-f98e3e9fd657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "tag": "fb9a2be7-8d62-4528-a23c-bfdf995bd6dc"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3c71f951-58fb-4db0-a818-ffe2a0182e7c req-da48924e-ccdd-4aab-a3cd-f98e3e9fd657 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3c71f951-58fb-4db0-a818-ffe2a0182e7c req-da48924e-ccdd-4aab-a3cd-f98e3e9fd657 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3c71f951-58fb-4db0-a818-ffe2a0182e7c req-da48924e-ccdd-4aab-a3cd-f98e3e9fd657 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3c71f951-58fb-4db0-a818-ffe2a0182e7c req-da48924e-ccdd-4aab-a3cd-f98e3e9fd657 service nova] Creating event network-changed:fb9a2be7-8d62-4528-a23c-bfdf995bd6dc for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:07:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3c71f951-58fb-4db0-a818-ffe2a0182e7c req-da48924e-ccdd-4aab-a3cd-f98e3e9fd657 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053988 Apr 14 03:07:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 156/465] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:15 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:15 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:16 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:16 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:16 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:16 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-511bf500-4868-4132-9d38-2a96455f7a5c tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a" status: 200 len: 1628 microversion: 2.49 time: 0.296591 Apr 14 03:07:16 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 156/466] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:07:15 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a => generated 1628 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:07:16 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "891ae671-db4d-49dd-92c7-efc22ae86a34", "tag": "nic-tag"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:16 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a24f90b1-52e5-424b-9878-6a4ec987741f req-a6f4a2f9-9139-4bb4-8050-c8710dd7bc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "093349f3-a544-487d-9927-f75c63ac2e9c"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "093349f3-a544-487d-9927-f75c63ac2e9c"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:16 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a24f90b1-52e5-424b-9878-6a4ec987741f req-a6f4a2f9-9139-4bb4-8050-c8710dd7bc2d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a24f90b1-52e5-424b-9878-6a4ec987741f req-a6f4a2f9-9139-4bb4-8050-c8710dd7bc2d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a24f90b1-52e5-424b-9878-6a4ec987741f req-a6f4a2f9-9139-4bb4-8050-c8710dd7bc2d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a24f90b1-52e5-424b-9878-6a4ec987741f req-a6f4a2f9-9139-4bb4-8050-c8710dd7bc2d service nova] Creating event network-vif-plugged:093349f3-a544-487d-9927-f75c63ac2e9c for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a24f90b1-52e5-424b-9878-6a4ec987741f req-a6f4a2f9-9139-4bb4-8050-c8710dd7bc2d service nova] Creating event network-vif-plugged:093349f3-a544-487d-9927-f75c63ac2e9c for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:07:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a24f90b1-52e5-424b-9878-6a4ec987741f req-a6f4a2f9-9139-4bb4-8050-c8710dd7bc2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064624 Apr 14 03:07:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 157/467] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1f027bd3-139d-4de5-ba6b-0425bce828c6 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] Calling method '.version_select at 0x7ff1181d39a0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:18 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1f027bd3-139d-4de5-ba6b-0425bce828c6 tempest-TestStampPattern-323884970 tempest-TestStampPattern-323884970-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1951210375" status: 202 len: 0 microversion: 2.1 time: 0.039359 Apr 14 03:07:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 157/468] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 03:07:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1951210375 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:07:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c55d7194-6b60-4e54-a6cb-f0fe09e5ee6d req-7716d8f5-2105-4da8-8722-6d8328dd3906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "tag": "bf026195-619f-4db1-a57a-1b3c0c83eb50"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c55d7194-6b60-4e54-a6cb-f0fe09e5ee6d req-7716d8f5-2105-4da8-8722-6d8328dd3906 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c55d7194-6b60-4e54-a6cb-f0fe09e5ee6d req-7716d8f5-2105-4da8-8722-6d8328dd3906 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c55d7194-6b60-4e54-a6cb-f0fe09e5ee6d req-7716d8f5-2105-4da8-8722-6d8328dd3906 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:18 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=28 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c55d7194-6b60-4e54-a6cb-f0fe09e5ee6d req-7716d8f5-2105-4da8-8722-6d8328dd3906 service nova] Creating event network-changed:bf026195-619f-4db1-a57a-1b3c0c83eb50 for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:07:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c55d7194-6b60-4e54-a6cb-f0fe09e5ee6d req-7716d8f5-2105-4da8-8722-6d8328dd3906 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039161 Apr 14 03:07:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 158/469] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:19 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:19 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-0c190eed-cc31-4146-937c-31291485c490 req-0b00cffe-566a-4d39-a879-44da5911928f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "name": "network-vif-plugged", "status": "completed", "tag": "bf026195-619f-4db1-a57a-1b3c0c83eb50"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:19 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-8bc3c1aa-a8c1-4a67-81a9-5376d44f11d8 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-interface" status: 200 len: 281 microversion: 2.49 time: 3.655739 Apr 14 03:07:19 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 155/470] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 03:07:16 2023] POST /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-interface => generated 281 bytes in 3657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:07:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b225a6ca-535b-4552-bead-7b02332b05ee tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5106df68-dc27-4e16-9ea7-9c77a3d4ca23", "tag": "volume-tag"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0c190eed-cc31-4146-937c-31291485c490 req-0b00cffe-566a-4d39-a879-44da5911928f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0c190eed-cc31-4146-937c-31291485c490 req-0b00cffe-566a-4d39-a879-44da5911928f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b225a6ca-535b-4552-bead-7b02332b05ee tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0c190eed-cc31-4146-937c-31291485c490 req-0b00cffe-566a-4d39-a879-44da5911928f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b225a6ca-535b-4552-bead-7b02332b05ee tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b225a6ca-535b-4552-bead-7b02332b05ee tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b225a6ca-535b-4552-bead-7b02332b05ee tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b225a6ca-535b-4552-bead-7b02332b05ee tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b225a6ca-535b-4552-bead-7b02332b05ee tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b225a6ca-535b-4552-bead-7b02332b05ee tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0c190eed-cc31-4146-937c-31291485c490 req-0b00cffe-566a-4d39-a879-44da5911928f service nova] Creating event network-vif-plugged:bf026195-619f-4db1-a57a-1b3c0c83eb50 for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:07:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-0c190eed-cc31-4146-937c-31291485c490 req-0b00cffe-566a-4d39-a879-44da5911928f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058191 Apr 14 03:07:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 158/471] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b225a6ca-535b-4552-bead-7b02332b05ee tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.354428 Apr 14 03:07:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 159/472] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 03:07:19 2023] POST /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:07:20 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d713ebb9-58ef-467d-bce0-3007b896717d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:20 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d713ebb9-58ef-467d-bce0-3007b896717d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d713ebb9-58ef-467d-bce0-3007b896717d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d713ebb9-58ef-467d-bce0-3007b896717d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d713ebb9-58ef-467d-bce0-3007b896717d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d713ebb9-58ef-467d-bce0-3007b896717d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d713ebb9-58ef-467d-bce0-3007b896717d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d713ebb9-58ef-467d-bce0-3007b896717d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:20 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-d713ebb9-58ef-467d-bce0-3007b896717d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:20 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d713ebb9-58ef-467d-bce0-3007b896717d tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531" status: 200 len: 1551 microversion: 2.1 time: 0.197072 Apr 14 03:07:20 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 156/473] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:07:20 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531 => generated 1551 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:07:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-99904da6-368c-42bf-a012-5c9f9e6fbe44 req-8bb60d8a-d4bb-4719-bff3-ef56de26aaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "name": "network-vif-plugged", "status": "completed", "tag": "bf026195-619f-4db1-a57a-1b3c0c83eb50"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-99904da6-368c-42bf-a012-5c9f9e6fbe44 req-8bb60d8a-d4bb-4719-bff3-ef56de26aaf5 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-99904da6-368c-42bf-a012-5c9f9e6fbe44 req-8bb60d8a-d4bb-4719-bff3-ef56de26aaf5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-99904da6-368c-42bf-a012-5c9f9e6fbe44 req-8bb60d8a-d4bb-4719-bff3-ef56de26aaf5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-99904da6-368c-42bf-a012-5c9f9e6fbe44 req-8bb60d8a-d4bb-4719-bff3-ef56de26aaf5 service nova] Creating event network-vif-plugged:bf026195-619f-4db1-a57a-1b3c0c83eb50 for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:07:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-99904da6-368c-42bf-a012-5c9f9e6fbe44 req-8bb60d8a-d4bb-4719-bff3-ef56de26aaf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053512 Apr 14 03:07:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 159/474] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:23 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-fada250b-9c91-4d33-8bec-191665790f50 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:23 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-fada250b-9c91-4d33-8bec-191665790f50 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fada250b-9c91-4d33-8bec-191665790f50 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fada250b-9c91-4d33-8bec-191665790f50 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fada250b-9c91-4d33-8bec-191665790f50 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fada250b-9c91-4d33-8bec-191665790f50 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fada250b-9c91-4d33-8bec-191665790f50 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fada250b-9c91-4d33-8bec-191665790f50 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:23 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-fada250b-9c91-4d33-8bec-191665790f50 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063250 Apr 14 03:07:23 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 160/475] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:07:23 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:07:23 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3f999d18-258d-4bcc-bbfa-72c079b4a049 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:23 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3f999d18-258d-4bcc-bbfa-72c079b4a049 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f999d18-258d-4bcc-bbfa-72c079b4a049 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f999d18-258d-4bcc-bbfa-72c079b4a049 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f999d18-258d-4bcc-bbfa-72c079b4a049 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f999d18-258d-4bcc-bbfa-72c079b4a049 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f999d18-258d-4bcc-bbfa-72c079b4a049 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3f999d18-258d-4bcc-bbfa-72c079b4a049 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:23 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3f999d18-258d-4bcc-bbfa-72c079b4a049 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:07:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3f999d18-258d-4bcc-bbfa-72c079b4a049 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 204 len: 0 microversion: 2.1 time: 0.143909 Apr 14 03:07:24 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 157/476] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:07:23 2023] DELETE /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:07:24 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2385a7be-91e0-4661-9584-921b67e4933d tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:24 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2385a7be-91e0-4661-9584-921b67e4933d tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2385a7be-91e0-4661-9584-921b67e4933d tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2385a7be-91e0-4661-9584-921b67e4933d tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2385a7be-91e0-4661-9584-921b67e4933d tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2385a7be-91e0-4661-9584-921b67e4933d tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2385a7be-91e0-4661-9584-921b67e4933d tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2385a7be-91e0-4661-9584-921b67e4933d tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:24 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-2385a7be-91e0-4661-9584-921b67e4933d tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2385a7be-91e0-4661-9584-921b67e4933d tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 200 len: 1661 microversion: 2.1 time: 0.197778 Apr 14 03:07:24 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 160/477] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:07:24 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 1661 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:07:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-f451386b-eb51-4757-bd85-95c6155582fc req-29167ba6-6e24-4323-9bff-2266fa3b2424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-unplugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f451386b-eb51-4757-bd85-95c6155582fc req-29167ba6-6e24-4323-9bff-2266fa3b2424 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f451386b-eb51-4757-bd85-95c6155582fc req-29167ba6-6e24-4323-9bff-2266fa3b2424 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f451386b-eb51-4757-bd85-95c6155582fc req-29167ba6-6e24-4323-9bff-2266fa3b2424 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f451386b-eb51-4757-bd85-95c6155582fc req-29167ba6-6e24-4323-9bff-2266fa3b2424 service nova] Creating event network-vif-unplugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:07:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-f451386b-eb51-4757-bd85-95c6155582fc req-29167ba6-6e24-4323-9bff-2266fa3b2424 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057760 Apr 14 03:07:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 161/478] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:25 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:25 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] [instance: 1fb18db3-28b0-4886-a680-4c534d31cb6b] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:25 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] HTTP exception thrown: Instance 1fb18db3-28b0-4886-a680-4c534d31cb6b could not be found. Apr 14 03:07:25 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Request method failure captured: Apr 14 03:07:25 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b HTTP/1.1 Apr 14 03:07:25 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:07:25 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:07:25 user devstack@n-api.service[61662]: Connection: close Apr 14 03:07:25 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:07:25 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:07:25 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:07:25 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:07:25 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMErwVvPJsjUJ3S0QPyBJwBGtPnN1VrL3KnPjbADURknqA0wkUZZ5eDBWtFcjFYFZZHeZil6ND7vyIhrBBYG50lpIyAGWg_8e4VgQYZfVgC3Jnm7MzkAyKb0p5axf2vM_aHXSvfx_x6W7PR7se8sYOcQ30uo0Jm_JeFuB_bek1E7GOY Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Project-Id: f021342634dd4f16bf2720533070154c Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Project-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021342634dd4f16bf2720533070154c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f021342634dd4f16bf2720533070154c"}]}] Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Tenant: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Tenant-Id: f021342634dd4f16bf2720533070154c Apr 14 03:07:25 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-ServersNegativeTestJSON-675126189 Apr 14 03:07:25 user devstack@n-api.service[61662]: X-User: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:07:25 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:07:25 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:07:25 user devstack@n-api.service[61662]: X-User-Id: 0dbce21e767a4a61b9213e38523d247e Apr 14 03:07:25 user devstack@n-api.service[61662]: X-User-Name: tempest-ServersNegativeTestJSON-675126189-project-member Apr 14 03:07:25 user devstack@n-api.service[61662]: method: > Apr 14 03:07:25 user devstack@n-api.service[61662]: exception: Instance 1fb18db3-28b0-4886-a680-4c534d31cb6b could not be found. Apr 14 03:07:25 user devstack@n-api.service[61662]: action_args: {'id': '1fb18db3-28b0-4886-a680-4c534d31cb6b'} Apr 14 03:07:25 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb18db3-28b0-4886-a680-4c534d31cb6b could not be found. Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb18db3-28b0-4886-a680-4c534d31cb6b could not be found. Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb18db3-28b0-4886-a680-4c534d31cb6b could not be found. Apr 14 03:07:25 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:25 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] Returning 404 to user: Instance 1fb18db3-28b0-4886-a680-4c534d31cb6b could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:07:25 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-edfcddd2-3c6d-4d9f-9ff1-bc166d3b2b3e tempest-ServersNegativeTestJSON-675126189 tempest-ServersNegativeTestJSON-675126189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b" status: 404 len: 111 microversion: 2.1 time: 0.061958 Apr 14 03:07:25 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 158/479] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:07:25 2023] GET /compute/v2.1/servers/1fb18db3-28b0-4886-a680-4c534d31cb6b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:07:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e0b39718-6c20-47dc-80c2-f5e218177f7b req-49161faf-97fa-4fcd-a056-e4cf84ae1dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}, {"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}, {"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}, {"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-unplugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}, {"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-plugged", "status": "completed", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e0b39718-6c20-47dc-80c2-f5e218177f7b req-49161faf-97fa-4fcd-a056-e4cf84ae1dc4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e0b39718-6c20-47dc-80c2-f5e218177f7b req-49161faf-97fa-4fcd-a056-e4cf84ae1dc4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e0b39718-6c20-47dc-80c2-f5e218177f7b req-49161faf-97fa-4fcd-a056-e4cf84ae1dc4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e0b39718-6c20-47dc-80c2-f5e218177f7b req-49161faf-97fa-4fcd-a056-e4cf84ae1dc4 service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:07:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e0b39718-6c20-47dc-80c2-f5e218177f7b req-49161faf-97fa-4fcd-a056-e4cf84ae1dc4 service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:07:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e0b39718-6c20-47dc-80c2-f5e218177f7b req-49161faf-97fa-4fcd-a056-e4cf84ae1dc4 service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:07:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e0b39718-6c20-47dc-80c2-f5e218177f7b req-49161faf-97fa-4fcd-a056-e4cf84ae1dc4 service nova] Creating event network-vif-unplugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:07:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e0b39718-6c20-47dc-80c2-f5e218177f7b req-49161faf-97fa-4fcd-a056-e4cf84ae1dc4 service nova] Creating event network-vif-plugged:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:07:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e0b39718-6c20-47dc-80c2-f5e218177f7b req-49161faf-97fa-4fcd-a056-e4cf84ae1dc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034227 Apr 14 03:07:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 161/480] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:26 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d548eec4-fd0d-46bb-bc03-0af3bcd075ec req-4d3a5579-6295-4ba7-adc8-63238963d712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb6cd58-ce7a-43ae-876d-51a888193f60", "name": "network-vif-deleted", "tag": "b85a839f-973d-415e-94b6-cdb480a8b89d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d548eec4-fd0d-46bb-bc03-0af3bcd075ec req-4d3a5579-6295-4ba7-adc8-63238963d712 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d548eec4-fd0d-46bb-bc03-0af3bcd075ec req-4d3a5579-6295-4ba7-adc8-63238963d712 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d548eec4-fd0d-46bb-bc03-0af3bcd075ec req-4d3a5579-6295-4ba7-adc8-63238963d712 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d548eec4-fd0d-46bb-bc03-0af3bcd075ec req-4d3a5579-6295-4ba7-adc8-63238963d712 service nova] Creating event network-vif-deleted:b85a839f-973d-415e-94b6-cdb480a8b89d for instance bbb6cd58-ce7a-43ae-876d-51a888193f60 on user Apr 14 03:07:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d548eec4-fd0d-46bb-bc03-0af3bcd075ec req-4d3a5579-6295-4ba7-adc8-63238963d712 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048943 Apr 14 03:07:26 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 162/481] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:28 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fb5db196-997f-4788-9f3f-be8b1c8eb506 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:28 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-fb5db196-997f-4788-9f3f-be8b1c8eb506 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fb5db196-997f-4788-9f3f-be8b1c8eb506 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fb5db196-997f-4788-9f3f-be8b1c8eb506 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fb5db196-997f-4788-9f3f-be8b1c8eb506 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fb5db196-997f-4788-9f3f-be8b1c8eb506 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fb5db196-997f-4788-9f3f-be8b1c8eb506 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fb5db196-997f-4788-9f3f-be8b1c8eb506 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:28 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-fb5db196-997f-4788-9f3f-be8b1c8eb506 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lazy-loading 'services' on Instance uuid 3e73add1-26be-47dd-adc5-506ab517544a {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:07:28 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-fb5db196-997f-4788-9f3f-be8b1c8eb506 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-volume_attachments/5106df68-dc27-4e16-9ea7-9c77a3d4ca23" status: 202 len: 0 microversion: 2.49 time: 0.187795 Apr 14 03:07:28 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 159/482] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 03:07:28 2023] DELETE /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-volume_attachments/5106df68-dc27-4e16-9ea7-9c77a3d4ca23 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:07:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-25803be4-0682-4a87-a90e-f51825bd728e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:30 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-25803be4-0682-4a87-a90e-f51825bd728e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25803be4-0682-4a87-a90e-f51825bd728e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25803be4-0682-4a87-a90e-f51825bd728e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25803be4-0682-4a87-a90e-f51825bd728e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25803be4-0682-4a87-a90e-f51825bd728e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25803be4-0682-4a87-a90e-f51825bd728e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25803be4-0682-4a87-a90e-f51825bd728e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-25803be4-0682-4a87-a90e-f51825bd728e tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-interface/bf026195-619f-4db1-a57a-1b3c0c83eb50" status: 202 len: 0 microversion: 2.49 time: 0.057165 Apr 14 03:07:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 162/483] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 03:07:30 2023] DELETE /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-interface/bf026195-619f-4db1-a57a-1b3c0c83eb50 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:07:30 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c420059e-fbd7-4a4c-9c7b-adeb4adf6a34 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:30 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c420059e-fbd7-4a4c-9c7b-adeb4adf6a34 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c420059e-fbd7-4a4c-9c7b-adeb4adf6a34 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c420059e-fbd7-4a4c-9c7b-adeb4adf6a34 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c420059e-fbd7-4a4c-9c7b-adeb4adf6a34 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c420059e-fbd7-4a4c-9c7b-adeb4adf6a34 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c420059e-fbd7-4a4c-9c7b-adeb4adf6a34 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c420059e-fbd7-4a4c-9c7b-adeb4adf6a34 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:30 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c420059e-fbd7-4a4c-9c7b-adeb4adf6a34 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-instance-actions/req-25803be4-0682-4a87-a90e-f51825bd728e" status: 200 len: 474 microversion: 2.49 time: 0.379475 Apr 14 03:07:30 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 163/484] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 03:07:30 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-instance-actions/req-25803be4-0682-4a87-a90e-f51825bd728e => generated 474 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:07:31 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-3025b323-dcbe-46fa-a1fe-c78bd0c59824 req-8f0cec6d-f417-4851-b3be-c3a737ae351d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "name": "network-vif-unplugged", "status": "completed", "tag": "bf026195-619f-4db1-a57a-1b3c0c83eb50"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-3025b323-dcbe-46fa-a1fe-c78bd0c59824 req-8f0cec6d-f417-4851-b3be-c3a737ae351d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-3025b323-dcbe-46fa-a1fe-c78bd0c59824 req-8f0cec6d-f417-4851-b3be-c3a737ae351d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-3025b323-dcbe-46fa-a1fe-c78bd0c59824 req-8f0cec6d-f417-4851-b3be-c3a737ae351d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:31 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-3025b323-dcbe-46fa-a1fe-c78bd0c59824 req-8f0cec6d-f417-4851-b3be-c3a737ae351d service nova] Creating event network-vif-unplugged:bf026195-619f-4db1-a57a-1b3c0c83eb50 for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:07:31 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-3025b323-dcbe-46fa-a1fe-c78bd0c59824 req-8f0cec6d-f417-4851-b3be-c3a737ae351d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036566 Apr 14 03:07:31 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 160/485] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:07:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-7e5e5ecf-bd8d-45cd-b834-7d50f8efe7c3 req-55f961a7-8672-45b0-a44d-0313a0d2eae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "name": "network-vif-deleted", "tag": "bf026195-619f-4db1-a57a-1b3c0c83eb50"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7e5e5ecf-bd8d-45cd-b834-7d50f8efe7c3 req-55f961a7-8672-45b0-a44d-0313a0d2eae4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7e5e5ecf-bd8d-45cd-b834-7d50f8efe7c3 req-55f961a7-8672-45b0-a44d-0313a0d2eae4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7e5e5ecf-bd8d-45cd-b834-7d50f8efe7c3 req-55f961a7-8672-45b0-a44d-0313a0d2eae4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-7e5e5ecf-bd8d-45cd-b834-7d50f8efe7c3 req-55f961a7-8672-45b0-a44d-0313a0d2eae4 service nova] Creating event network-vif-deleted:bf026195-619f-4db1-a57a-1b3c0c83eb50 for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:07:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-7e5e5ecf-bd8d-45cd-b834-7d50f8efe7c3 req-55f961a7-8672-45b0-a44d-0313a0d2eae4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041834 Apr 14 03:07:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 163/486] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:07:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-51bb6a4d-6907-429f-8a5e-47fcfe30e8b6 req-3b37f326-8b18-4d78-9834-1852143235a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "name": "network-vif-plugged", "status": "completed", "tag": "bf026195-619f-4db1-a57a-1b3c0c83eb50"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-51bb6a4d-6907-429f-8a5e-47fcfe30e8b6 req-3b37f326-8b18-4d78-9834-1852143235a2 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-51bb6a4d-6907-429f-8a5e-47fcfe30e8b6 req-3b37f326-8b18-4d78-9834-1852143235a2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-51bb6a4d-6907-429f-8a5e-47fcfe30e8b6 req-3b37f326-8b18-4d78-9834-1852143235a2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-51bb6a4d-6907-429f-8a5e-47fcfe30e8b6 req-3b37f326-8b18-4d78-9834-1852143235a2 service nova] Creating event network-vif-plugged:bf026195-619f-4db1-a57a-1b3c0c83eb50 for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:07:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-51bb6a4d-6907-429f-8a5e-47fcfe30e8b6 req-3b37f326-8b18-4d78-9834-1852143235a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052788 Apr 14 03:07:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 164/487] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:07:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:07:38 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3520e7be-7e58-42da-b0be-f8fb8db6a1eb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:38 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3520e7be-7e58-42da-b0be-f8fb8db6a1eb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3520e7be-7e58-42da-b0be-f8fb8db6a1eb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3520e7be-7e58-42da-b0be-f8fb8db6a1eb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3520e7be-7e58-42da-b0be-f8fb8db6a1eb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3520e7be-7e58-42da-b0be-f8fb8db6a1eb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3520e7be-7e58-42da-b0be-f8fb8db6a1eb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3520e7be-7e58-42da-b0be-f8fb8db6a1eb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:38 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-3520e7be-7e58-42da-b0be-f8fb8db6a1eb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3520e7be-7e58-42da-b0be-f8fb8db6a1eb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1729 microversion: 2.1 time: 0.203865 Apr 14 03:07:38 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 161/488] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:07:38 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:39 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-709b63fd-f4bd-4860-a5bb-4c3ff669e4e3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93" status: 200 len: 2831 microversion: 2.42 time: 0.208248 Apr 14 03:07:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 164/489] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:07:39 2023] GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 => generated 2831 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:07:56 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=15 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:56 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1770273062", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "de8764bb-1ca4-4c30-8dee-bce850658327"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] validate_networks() for [('de8764bb-1ca4-4c30-8dee-bce850658327', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Getting quotas for project bd2c5b2aafaf4ca7bf62e988ac726658. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Getting quotas for user d666936eb0ee43a2ad9e17a12e6e273d and project bd2c5b2aafaf4ca7bf62e988ac726658. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:07:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:07:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-389ef989-72f9-4d4a-be54-d3c283d3f5aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.832017 Apr 14 03:07:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 165/490] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 03:07:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 03:07:57 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-42bde4b5-6a3d-4671-9810-55ff9e8469ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:57 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-42bde4b5-6a3d-4671-9810-55ff9e8469ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:57 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:57 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:57 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-42bde4b5-6a3d-4671-9810-55ff9e8469ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:57 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-42bde4b5-6a3d-4671-9810-55ff9e8469ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:57 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-42bde4b5-6a3d-4671-9810-55ff9e8469ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:07:57 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-42bde4b5-6a3d-4671-9810-55ff9e8469ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a" status: 200 len: 1395 microversion: 2.87 time: 0.219473 Apr 14 03:07:57 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 162/491] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:07:57 2023] GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a => generated 1395 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=24,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:07:58 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef HTTP/1.1 Apr 14 03:07:58 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:07:58 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:07:58 user devstack@n-api.service[61664]: Connection: close Apr 14 03:07:58 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:07:58 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:07:58 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:07:58 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:07:58 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:58 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:07:58 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:07:58 user devstack@n-api.service[61664]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:58 user devstack@n-api.service[61664]: method: > Apr 14 03:07:58 user devstack@n-api.service[61664]: exception: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61664]: action_args: {'id': 'f970adb1-fe1b-4b58-83aa-45207a6211ef'} Apr 14 03:07:58 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:07:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a9344a21-b855-4e38-81f8-89b6f1b1d6fe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef" status: 404 len: 111 microversion: 2.1 time: 0.052924 Apr 14 03:07:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 165/492] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:07:58 2023] GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 62cad020-0344-4e4e-add9-e5bc6175adbb] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:07:58 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb HTTP/1.1 Apr 14 03:07:58 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:07:58 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:07:58 user devstack@n-api.service[61663]: Connection: close Apr 14 03:07:58 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:07:58 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:07:58 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:07:58 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:07:58 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:58 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:07:58 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:07:58 user devstack@n-api.service[61663]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:58 user devstack@n-api.service[61663]: method: > Apr 14 03:07:58 user devstack@n-api.service[61663]: exception: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:58 user devstack@n-api.service[61663]: action_args: {'id': '62cad020-0344-4e4e-add9-e5bc6175adbb'} Apr 14 03:07:58 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:07:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-fe1cf507-6de2-41e8-827c-bfae4a9963da tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb" status: 404 len: 111 microversion: 2.1 time: 0.030047 Apr 14 03:07:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 166/493] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:07:58 2023] DELETE /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:07:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:58 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 62cad020-0344-4e4e-add9-e5bc6175adbb] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:58 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:07:58 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb HTTP/1.1 Apr 14 03:07:58 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:07:58 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:07:58 user devstack@n-api.service[61662]: Connection: close Apr 14 03:07:58 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:07:58 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:07:58 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:07:58 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:07:58 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:58 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61662]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:58 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:07:58 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:07:58 user devstack@n-api.service[61662]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:07:58 user devstack@n-api.service[61662]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:58 user devstack@n-api.service[61662]: method: > Apr 14 03:07:58 user devstack@n-api.service[61662]: exception: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:58 user devstack@n-api.service[61662]: action_args: {'id': '62cad020-0344-4e4e-add9-e5bc6175adbb'} Apr 14 03:07:58 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. Apr 14 03:07:58 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance 62cad020-0344-4e4e-add9-e5bc6175adbb could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:07:58 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a342f3a2-9827-4894-96e2-b1476c5a301d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb" status: 404 len: 111 microversion: 2.1 time: 0.028899 Apr 14 03:07:58 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 163/494] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:07:58 2023] GET /compute/v2.1/servers/62cad020-0344-4e4e-add9-e5bc6175adbb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:07:58 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef HTTP/1.1 Apr 14 03:07:58 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:07:58 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:07:58 user devstack@n-api.service[61664]: Connection: close Apr 14 03:07:58 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:07:58 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:07:58 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:07:58 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:07:58 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:58 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:07:58 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:07:58 user devstack@n-api.service[61664]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:07:58 user devstack@n-api.service[61664]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:58 user devstack@n-api.service[61664]: method: > Apr 14 03:07:58 user devstack@n-api.service[61664]: exception: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61664]: action_args: {'id': 'f970adb1-fe1b-4b58-83aa-45207a6211ef'} Apr 14 03:07:58 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:07:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e1587dc8-e219-4e17-a3af-01ec5c601aac tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef" status: 404 len: 111 microversion: 2.1 time: 0.031717 Apr 14 03:07:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 166/495] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:07:58 2023] DELETE /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: f970adb1-fe1b-4b58-83aa-45207a6211ef] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:07:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:07:58 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef HTTP/1.1 Apr 14 03:07:58 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:07:58 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:07:58 user devstack@n-api.service[61663]: Connection: close Apr 14 03:07:58 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:07:58 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:07:58 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:07:58 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:07:58 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:58 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:07:58 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:07:58 user devstack@n-api.service[61663]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:07:58 user devstack@n-api.service[61663]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:07:58 user devstack@n-api.service[61663]: method: > Apr 14 03:07:58 user devstack@n-api.service[61663]: exception: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61663]: action_args: {'id': 'f970adb1-fe1b-4b58-83aa-45207a6211ef'} Apr 14 03:07:58 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. Apr 14 03:07:58 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:07:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance f970adb1-fe1b-4b58-83aa-45207a6211ef could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:07:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-513a3712-261a-463c-a9c3-4c18815b07f2 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef" status: 404 len: 111 microversion: 2.1 time: 0.032727 Apr 14 03:07:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 167/496] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:07:58 2023] GET /compute/v2.1/servers/f970adb1-fe1b-4b58-83aa-45207a6211ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:07:59 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a1fdb420-19bb-4b34-87af-937a80411462 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Action: 'create', calling method: .version_select at 0x7ff11a4b4e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-742486677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBsGfTnZtORAtMl//kkVhwXLO6q/szIxAnXs+gkckXj87K6zFVRS8GVQwVtrdT+ALB5PZ6w19ZXaBNEZoStHoMq1JdVvJjvDhLnJ6fjJJYgW5mf6nPdJbsmeMcY5EC9qQ=="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:07:59 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-a1fdb420-19bb-4b34-87af-937a80411462 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:07:59 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-a1fdb420-19bb-4b34-87af-937a80411462 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for user 60e11b7ab2914209b23bf7a53791da64 and project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:07:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a1fdb420-19bb-4b34-87af-937a80411462 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.046465 Apr 14 03:07:59 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 164/497] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:07:59 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-8122c68f-534d-4417-9c75-d72fea68d883 req-97c37b05-d116-446d-a104-f215af0e5da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8122c68f-534d-4417-9c75-d72fea68d883 req-97c37b05-d116-446d-a104-f215af0e5da1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8122c68f-534d-4417-9c75-d72fea68d883 req-97c37b05-d116-446d-a104-f215af0e5da1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8122c68f-534d-4417-9c75-d72fea68d883 req-97c37b05-d116-446d-a104-f215af0e5da1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-8122c68f-534d-4417-9c75-d72fea68d883 req-97c37b05-d116-446d-a104-f215af0e5da1 service nova] Creating event network-changed:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:08:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-8122c68f-534d-4417-9c75-d72fea68d883 req-97c37b05-d116-446d-a104-f215af0e5da1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028616 Apr 14 03:08:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 167/498] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1962356101", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-742486677", "security_groups": [{"name": "tempest-secgroup-smoke-1898708055"}], "block_device_mapping_v2": [{"uuid": "c6fbfee2-70fa-477a-a761-8d092061e691", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ea0f3bca-5794-46e4-a270-53dbe99375bd"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:04 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] validate_networks() for [('ea0f3bca-5794-46e4-a270-53dbe99375bd', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for user 60e11b7ab2914209b23bf7a53791da64 and project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:08:05 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7a1e2563-0dc3-4cc9-aa61-7cb321f28622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6fbfee2-70fa-477a-a761-8d092061e691',volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:08:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.731644 Apr 14 03:08:05 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 168/499] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:08:04 2023] POST /compute/v2.1/servers => generated 404 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:08:05 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3dde0504-8ba7-44a3-95d9-cac4b32a7787 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:05 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3dde0504-8ba7-44a3-95d9-cac4b32a7787 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7a1e2563-0dc3-4cc9-aa61-7cb321f28622] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:05 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-3dde0504-8ba7-44a3-95d9-cac4b32a7787 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:05 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3dde0504-8ba7-44a3-95d9-cac4b32a7787 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622" status: 200 len: 1089 microversion: 2.1 time: 0.074552 Apr 14 03:08:05 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 165/500] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:08:05 2023] GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:08:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a728ab7c-8473-44ba-ade0-7aa7ae3efe26 req-325b9754-f95d-4f6d-a12f-4ce3cb00467c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a1e2563-0dc3-4cc9-aa61-7cb321f28622", "tag": "3ca37a66-26b1-4ab0-99fa-96237e59345f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a728ab7c-8473-44ba-ade0-7aa7ae3efe26 req-325b9754-f95d-4f6d-a12f-4ce3cb00467c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a728ab7c-8473-44ba-ade0-7aa7ae3efe26 req-325b9754-f95d-4f6d-a12f-4ce3cb00467c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a728ab7c-8473-44ba-ade0-7aa7ae3efe26 req-325b9754-f95d-4f6d-a12f-4ce3cb00467c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a728ab7c-8473-44ba-ade0-7aa7ae3efe26 req-325b9754-f95d-4f6d-a12f-4ce3cb00467c service nova] Creating event network-changed:3ca37a66-26b1-4ab0-99fa-96237e59345f for instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 on user Apr 14 03:08:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a728ab7c-8473-44ba-ade0-7aa7ae3efe26 req-325b9754-f95d-4f6d-a12f-4ce3cb00467c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052470 Apr 14 03:08:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 168/501] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3f3a076c-35e3-4406-95e5-55d0f7a766b2 req-dcc6ed9f-4c4e-4758-85c7-8635259eac18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3f3a076c-35e3-4406-95e5-55d0f7a766b2 req-dcc6ed9f-4c4e-4758-85c7-8635259eac18 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3f3a076c-35e3-4406-95e5-55d0f7a766b2 req-dcc6ed9f-4c4e-4758-85c7-8635259eac18 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3f3a076c-35e3-4406-95e5-55d0f7a766b2 req-dcc6ed9f-4c4e-4758-85c7-8635259eac18 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3f3a076c-35e3-4406-95e5-55d0f7a766b2 req-dcc6ed9f-4c4e-4758-85c7-8635259eac18 service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:08:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3f3a076c-35e3-4406-95e5-55d0f7a766b2 req-dcc6ed9f-4c4e-4758-85c7-8635259eac18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092927 Apr 14 03:08:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 169/502] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] HTTP exception thrown: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Request method failure captured: Apr 14 03:08:14 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 HTTP/1.1 Apr 14 03:08:14 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:08:14 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:08:14 user devstack@n-api.service[61662]: Connection: close Apr 14 03:08:14 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:08:14 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:08:14 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:08:14 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:08:14 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEniurR-XYJH0ZsYBHACYc2Zz3VSVL6yUXC8j91UZj78M-vPYDpcO60-6eaqaHLWYpPbpccNUvjFp9pyS_m4sBAblTzSWOml6ZCQK1pdCAcsetJPcy0uVsyqGF5p5SZT3i5ItzPWKpdfOldEDH_gufTZE_3MMAqDqtKJlFrrg7DPAU Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Project-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Project-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/130665008cf648cf87467ae2777a9170"}]}] Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Tenant: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Tenant-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:08:14 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:08:14 user devstack@n-api.service[61662]: X-User: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:08:14 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:08:14 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:08:14 user devstack@n-api.service[61662]: X-User-Id: d6d78d4991b5493e8893034e91ed407b Apr 14 03:08:14 user devstack@n-api.service[61662]: X-User-Name: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:08:14 user devstack@n-api.service[61662]: method: > Apr 14 03:08:14 user devstack@n-api.service[61662]: exception: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:08:14 user devstack@n-api.service[61662]: action_args: {'id': 'bbb6cd58-ce7a-43ae-876d-51a888193f60'} Apr 14 03:08:14 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:08:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Returning 404 to user: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:08:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d7ec8fa6-e76d-4914-a843-19944007a27b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 404 len: 111 microversion: 2.1 time: 0.045862 Apr 14 03:08:14 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 166/503] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:08:14 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:08:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4f4f67c6-3e59-42ad-ad36-544c6b673348 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '.version_select at 0x7ff1181d2830>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4f4f67c6-3e59-42ad-ad36-544c6b673348 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1156063861" status: 202 len: 0 microversion: 2.1 time: 0.034732 Apr 14 03:08:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 169/504] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 03:08:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1156063861 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:08:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-e90152a2-409a-4596-8bf1-bffb19126e18 req-8c0cb064-c6da-48c8-9bb4-ab34fe738b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1e2563-0dc3-4cc9-aa61-7cb321f28622", "name": "network-vif-plugged", "status": "completed", "tag": "3ca37a66-26b1-4ab0-99fa-96237e59345f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e90152a2-409a-4596-8bf1-bffb19126e18 req-8c0cb064-c6da-48c8-9bb4-ab34fe738b55 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e90152a2-409a-4596-8bf1-bffb19126e18 req-8c0cb064-c6da-48c8-9bb4-ab34fe738b55 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e90152a2-409a-4596-8bf1-bffb19126e18 req-8c0cb064-c6da-48c8-9bb4-ab34fe738b55 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-8d679135-7470-450d-9887-acb8b6265667 req-52f36403-9a30-46a1-893a-6a7c87607ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e90152a2-409a-4596-8bf1-bffb19126e18 req-8c0cb064-c6da-48c8-9bb4-ab34fe738b55 service nova] Creating event network-vif-plugged:3ca37a66-26b1-4ab0-99fa-96237e59345f for instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 on user Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8d679135-7470-450d-9887-acb8b6265667 req-52f36403-9a30-46a1-893a-6a7c87607ddd service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8d679135-7470-450d-9887-acb8b6265667 req-52f36403-9a30-46a1-893a-6a7c87607ddd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8d679135-7470-450d-9887-acb8b6265667 req-52f36403-9a30-46a1-893a-6a7c87607ddd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-e90152a2-409a-4596-8bf1-bffb19126e18 req-8c0cb064-c6da-48c8-9bb4-ab34fe738b55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146272 Apr 14 03:08:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 170/505] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:08:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8d679135-7470-450d-9887-acb8b6265667 req-52f36403-9a30-46a1-893a-6a7c87607ddd service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:08:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-8d679135-7470-450d-9887-acb8b6265667 req-52f36403-9a30-46a1-893a-6a7c87607ddd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042669 Apr 14 03:08:14 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 167/506] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:08:15 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b575da35-933b-4fed-904a-fe5de7583dfc tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'create', calling method: .version_select at 0x7ff11a2dbac0>, body: {"keypair": {"name": "tempest-keypair-1327512481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFjzX0+40uO37CfqkOBSmbMWwyV5wsfc6L7vAuDWYejkbH4JLkWAIz1Wn0uLtB1OjrTaShOAhE1miwOi7ekeCgSgaeKQp/3FeYMl2Pn1H8x1Gn7ZQIusaMOU4fzl1tfrQ=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:15 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-b575da35-933b-4fed-904a-fe5de7583dfc tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Getting quotas for project 130665008cf648cf87467ae2777a9170. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:08:15 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-b575da35-933b-4fed-904a-fe5de7583dfc tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Getting quotas for user d6d78d4991b5493e8893034e91ed407b and project 130665008cf648cf87467ae2777a9170. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:08:15 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b575da35-933b-4fed-904a-fe5de7583dfc tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064311 Apr 14 03:08:15 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 170/507] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:08:15 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:17 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:17 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=12 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:17 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-2c362945-03b3-447d-aca4-8d957b4bbf5e req-5372a4a2-376a-4627-8f3e-5518548f3922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1e2563-0dc3-4cc9-aa61-7cb321f28622", "name": "network-vif-plugged", "status": "completed", "tag": "3ca37a66-26b1-4ab0-99fa-96237e59345f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2c362945-03b3-447d-aca4-8d957b4bbf5e req-5372a4a2-376a-4627-8f3e-5518548f3922 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2c362945-03b3-447d-aca4-8d957b4bbf5e req-5372a4a2-376a-4627-8f3e-5518548f3922 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2c362945-03b3-447d-aca4-8d957b4bbf5e req-5372a4a2-376a-4627-8f3e-5518548f3922 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-2c362945-03b3-447d-aca4-8d957b4bbf5e req-5372a4a2-376a-4627-8f3e-5518548f3922 service nova] Creating event network-vif-plugged:3ca37a66-26b1-4ab0-99fa-96237e59345f for instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 on user Apr 14 03:08:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-2c362945-03b3-447d-aca4-8d957b4bbf5e req-5372a4a2-376a-4627-8f3e-5518548f3922 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036725 Apr 14 03:08:17 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 171/508] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:17 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=8 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:17 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1987903443", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "079db793-280b-4ba4-8733-eec1c8591b70"}], "security_groups": [{"name": "tempest-securitygroup--96926288"}], "key_name": "tempest-keypair-1327512481", "user_data": "}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:17 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] validate_networks() for [('079db793-280b-4ba4-8733-eec1c8591b70', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Getting quotas for project 130665008cf648cf87467ae2777a9170. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Getting quotas for user d6d78d4991b5493e8893034e91ed407b and project 130665008cf648cf87467ae2777a9170. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:08:18 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:08:18 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-73f66d54-3d07-42c4-8d86-8ecf076c7829 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 0.648852 Apr 14 03:08:18 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 168/509] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:08:17 2023] POST /compute/v2.1/servers => generated 398 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:08:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a84b5576-3421-41d9-a625-11c8fb42e581 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:18 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a84b5576-3421-41d9-a625-11c8fb42e581 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:18 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a84b5576-3421-41d9-a625-11c8fb42e581 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a84b5576-3421-41d9-a625-11c8fb42e581 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d" status: 200 len: 1232 microversion: 2.1 time: 0.212343 Apr 14 03:08:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 171/510] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:08:18 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d => generated 1232 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:08:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4902c373-dc52-4c1c-986a-9307ef88d171 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:20 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4902c373-dc52-4c1c-986a-9307ef88d171 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4902c373-dc52-4c1c-986a-9307ef88d171 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4902c373-dc52-4c1c-986a-9307ef88d171 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4902c373-dc52-4c1c-986a-9307ef88d171 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4902c373-dc52-4c1c-986a-9307ef88d171 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4902c373-dc52-4c1c-986a-9307ef88d171 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4902c373-dc52-4c1c-986a-9307ef88d171 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:20 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-0be2c462-3416-4db4-a6b1-414abd7bcab0 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:20 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-0be2c462-3416-4db4-a6b1-414abd7bcab0 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4902c373-dc52-4c1c-986a-9307ef88d171 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.173897 Apr 14 03:08:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 172/511] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:08:20 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-interface => generated 282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0be2c462-3416-4db4-a6b1-414abd7bcab0 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0be2c462-3416-4db4-a6b1-414abd7bcab0 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0be2c462-3416-4db4-a6b1-414abd7bcab0 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0be2c462-3416-4db4-a6b1-414abd7bcab0 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0be2c462-3416-4db4-a6b1-414abd7bcab0 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0be2c462-3416-4db4-a6b1-414abd7bcab0 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b5a607f1-9682-47d7-bf74-97e0d13e031a req-47c1d09d-d0f7-421d-b667-d724bc5f45b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4bbe1e-d297-40e2-95d5-d8ab381c302d", "tag": "cf6c0efd-f0d7-4a17-837f-eefb2b1a5731"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b5a607f1-9682-47d7-bf74-97e0d13e031a req-47c1d09d-d0f7-421d-b667-d724bc5f45b5 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b5a607f1-9682-47d7-bf74-97e0d13e031a req-47c1d09d-d0f7-421d-b667-d724bc5f45b5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b5a607f1-9682-47d7-bf74-97e0d13e031a req-47c1d09d-d0f7-421d-b667-d724bc5f45b5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-0be2c462-3416-4db4-a6b1-414abd7bcab0 tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-instance-actions/req-25803be4-0682-4a87-a90e-f51825bd728e" status: 200 len: 503 microversion: 2.49 time: 0.105701 Apr 14 03:08:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 169/512] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 03:08:20 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-instance-actions/req-25803be4-0682-4a87-a90e-f51825bd728e => generated 503 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:08:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b5a607f1-9682-47d7-bf74-97e0d13e031a req-47c1d09d-d0f7-421d-b667-d724bc5f45b5 service nova] Creating event network-changed:cf6c0efd-f0d7-4a17-837f-eefb2b1a5731 for instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d on user Apr 14 03:08:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b5a607f1-9682-47d7-bf74-97e0d13e031a req-47c1d09d-d0f7-421d-b667-d724bc5f45b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035533 Apr 14 03:08:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 172/513] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-be72d19c-c153-4d55-ae81-034fb3251b2f tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-be72d19c-c153-4d55-ae81-034fb3251b2f tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be72d19c-c153-4d55-ae81-034fb3251b2f tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be72d19c-c153-4d55-ae81-034fb3251b2f tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be72d19c-c153-4d55-ae81-034fb3251b2f tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be72d19c-c153-4d55-ae81-034fb3251b2f tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be72d19c-c153-4d55-ae81-034fb3251b2f tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be72d19c-c153-4d55-ae81-034fb3251b2f tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-be72d19c-c153-4d55-ae81-034fb3251b2f tempest-TaggedAttachmentsTest-1106632949 tempest-TaggedAttachmentsTest-1106632949-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-instance-actions/req-25803be4-0682-4a87-a90e-f51825bd728e" status: 200 len: 503 microversion: 2.49 time: 0.060738 Apr 14 03:08:21 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 173/514] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 03:08:21 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-instance-actions/req-25803be4-0682-4a87-a90e-f51825bd728e => generated 503 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-115f956e-8669-4573-ba8a-4d944ddf6a57 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-115f956e-8669-4573-ba8a-4d944ddf6a57 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-115f956e-8669-4573-ba8a-4d944ddf6a57 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-115f956e-8669-4573-ba8a-4d944ddf6a57 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-115f956e-8669-4573-ba8a-4d944ddf6a57 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-115f956e-8669-4573-ba8a-4d944ddf6a57 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-115f956e-8669-4573-ba8a-4d944ddf6a57 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-115f956e-8669-4573-ba8a-4d944ddf6a57 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-115f956e-8669-4573-ba8a-4d944ddf6a57 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.043072 Apr 14 03:08:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 170/515] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 03:08:21 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e7677c39-ff67-4617-b98e-39e9a163f57f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e7677c39-ff67-4617-b98e-39e9a163f57f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7677c39-ff67-4617-b98e-39e9a163f57f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7677c39-ff67-4617-b98e-39e9a163f57f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7677c39-ff67-4617-b98e-39e9a163f57f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7677c39-ff67-4617-b98e-39e9a163f57f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7677c39-ff67-4617-b98e-39e9a163f57f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e7677c39-ff67-4617-b98e-39e9a163f57f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e7677c39-ff67-4617-b98e-39e9a163f57f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:08:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e7677c39-ff67-4617-b98e-39e9a163f57f tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a" status: 204 len: 0 microversion: 2.49 time: 0.175366 Apr 14 03:08:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 173/516] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:08:21 2023] DELETE /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:21 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17999fdd4eb449d49d74b4de20f6614a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a991a4fd13b4a819b24479a341ba08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-640d19f2-5aff-40e2-b162-4ee06cdd5257 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a" status: 200 len: 1752 microversion: 2.49 time: 0.370300 Apr 14 03:08:21 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 174/517] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:08:21 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a => generated 1752 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:08:22 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-92cc9b25-c295-461c-8f5e-788888e0d56f req-f433dfd0-dfa1-43b1-b63f-a104fe5effc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "name": "network-vif-unplugged", "status": "completed", "tag": "fb9a2be7-8d62-4528-a23c-bfdf995bd6dc"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-92cc9b25-c295-461c-8f5e-788888e0d56f req-f433dfd0-dfa1-43b1-b63f-a104fe5effc9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-92cc9b25-c295-461c-8f5e-788888e0d56f req-f433dfd0-dfa1-43b1-b63f-a104fe5effc9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-92cc9b25-c295-461c-8f5e-788888e0d56f req-f433dfd0-dfa1-43b1-b63f-a104fe5effc9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:22 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-92cc9b25-c295-461c-8f5e-788888e0d56f req-f433dfd0-dfa1-43b1-b63f-a104fe5effc9 service nova] Creating event network-vif-unplugged:fb9a2be7-8d62-4528-a23c-bfdf995bd6dc for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:08:22 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-92cc9b25-c295-461c-8f5e-788888e0d56f req-f433dfd0-dfa1-43b1-b63f-a104fe5effc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114087 Apr 14 03:08:22 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 171/518] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05d362e8-1aaf-4bbb-8a9f-9f153920e00c"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:22 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332420 Apr 14 03:08:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 174/519] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:08:22 2023] POST /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-f7dab195-16c7-4877-bd77-61121de67d43 req-5dd311b5-3ae2-4a48-9295-240d511cc135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}, {"server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "name": "network-vif-plugged", "status": "completed", "tag": "fb9a2be7-8d62-4528-a23c-bfdf995bd6dc"}, {"server_uuid": "9c4bbe1e-d297-40e2-95d5-d8ab381c302d", "name": "network-vif-plugged", "status": "completed", "tag": "cf6c0efd-f0d7-4a17-837f-eefb2b1a5731"}, {"server_uuid": "9c4bbe1e-d297-40e2-95d5-d8ab381c302d", "name": "network-vif-plugged", "status": "completed", "tag": "cf6c0efd-f0d7-4a17-837f-eefb2b1a5731"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f7dab195-16c7-4877-bd77-61121de67d43 req-5dd311b5-3ae2-4a48-9295-240d511cc135 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f7dab195-16c7-4877-bd77-61121de67d43 req-5dd311b5-3ae2-4a48-9295-240d511cc135 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f7dab195-16c7-4877-bd77-61121de67d43 req-5dd311b5-3ae2-4a48-9295-240d511cc135 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f7dab195-16c7-4877-bd77-61121de67d43 req-5dd311b5-3ae2-4a48-9295-240d511cc135 service nova] Creating event network-changed:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:08:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f7dab195-16c7-4877-bd77-61121de67d43 req-5dd311b5-3ae2-4a48-9295-240d511cc135 service nova] Creating event network-vif-plugged:fb9a2be7-8d62-4528-a23c-bfdf995bd6dc for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:08:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f7dab195-16c7-4877-bd77-61121de67d43 req-5dd311b5-3ae2-4a48-9295-240d511cc135 service nova] Creating event network-vif-plugged:cf6c0efd-f0d7-4a17-837f-eefb2b1a5731 for instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d on user Apr 14 03:08:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f7dab195-16c7-4877-bd77-61121de67d43 req-5dd311b5-3ae2-4a48-9295-240d511cc135 service nova] Creating event network-vif-plugged:cf6c0efd-f0d7-4a17-837f-eefb2b1a5731 for instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d on user Apr 14 03:08:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-f7dab195-16c7-4877-bd77-61121de67d43 req-5dd311b5-3ae2-4a48-9295-240d511cc135 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.049911 Apr 14 03:08:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 175/520] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:08:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-b5fd7af6-81eb-4b01-9aa0-cf3f2c2da1ef req-5535f4a9-feb6-47e2-8643-23fd6fee6dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73add1-26be-47dd-adc5-506ab517544a", "name": "network-vif-deleted", "tag": "fb9a2be7-8d62-4528-a23c-bfdf995bd6dc"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b5fd7af6-81eb-4b01-9aa0-cf3f2c2da1ef req-5535f4a9-feb6-47e2-8643-23fd6fee6dfe service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b5fd7af6-81eb-4b01-9aa0-cf3f2c2da1ef req-5535f4a9-feb6-47e2-8643-23fd6fee6dfe service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b5fd7af6-81eb-4b01-9aa0-cf3f2c2da1ef req-5535f4a9-feb6-47e2-8643-23fd6fee6dfe service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-b5fd7af6-81eb-4b01-9aa0-cf3f2c2da1ef req-5535f4a9-feb6-47e2-8643-23fd6fee6dfe service nova] Creating event network-vif-deleted:fb9a2be7-8d62-4528-a23c-bfdf995bd6dc for instance 3e73add1-26be-47dd-adc5-506ab517544a on user Apr 14 03:08:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-b5fd7af6-81eb-4b01-9aa0-cf3f2c2da1ef req-5535f4a9-feb6-47e2-8643-23fd6fee6dfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031457 Apr 14 03:08:24 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 172/521] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:08:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2069905968", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "bdc97991-26cc-4e5b-8d38-a1f750e7dd2c"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:27 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] validate_networks() for [('bdc97991-26cc-4e5b-8d38-a1f750e7dd2c', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Getting quotas for project 4549f6080dcf4c739ac03ef643801fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Getting quotas for user 0128a733bd6a4120addba5eda1cc05fb and project 4549f6080dcf4c739ac03ef643801fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:08:28 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: e1493ecb-e6a8-48c5-abf3-d3cbc092736a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:08:28 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8f9087d3-0644-4725-b707-42a5ca7463e5 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.671120 Apr 14 03:08:28 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 175/522] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:08:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:08:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d0229f0e-f039-41e7-b2cf-eaa88f409d92 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:28 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d0229f0e-f039-41e7-b2cf-eaa88f409d92 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: e1493ecb-e6a8-48c5-abf3-d3cbc092736a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:28 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:28 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-d0229f0e-f039-41e7-b2cf-eaa88f409d92 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0128a733bd6a4120addba5eda1cc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4549f6080dcf4c739ac03ef643801fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d0229f0e-f039-41e7-b2cf-eaa88f409d92 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a" status: 200 len: 1213 microversion: 2.1 time: 0.078026 Apr 14 03:08:28 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 176/523] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:08:28 2023] GET /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fe428e47-805a-4867-99f4-3ff1cabb7e87 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-fe428e47-805a-4867-99f4-3ff1cabb7e87 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe428e47-805a-4867-99f4-3ff1cabb7e87 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe428e47-805a-4867-99f4-3ff1cabb7e87 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe428e47-805a-4867-99f4-3ff1cabb7e87 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe428e47-805a-4867-99f4-3ff1cabb7e87 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe428e47-805a-4867-99f4-3ff1cabb7e87 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fe428e47-805a-4867-99f4-3ff1cabb7e87 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:30 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-fe428e47-805a-4867-99f4-3ff1cabb7e87 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lazy-loading 'flavor' on Instance uuid 4e47adee-bd94-4655-9bbd-ed59c5478531 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:08:30 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-fe428e47-805a-4867-99f4-3ff1cabb7e87 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/action" status: 200 len: 32 microversion: 2.1 time: 0.180128 Apr 14 03:08:30 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 173/524] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:08:30 2023] POST /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:08:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1a9fdc74-49a3-45b0-995f-5bf708560b96 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:30 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1a9fdc74-49a3-45b0-995f-5bf708560b96 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:30 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc74-49a3-45b0-995f-5bf708560b96 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc74-49a3-45b0-995f-5bf708560b96 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc74-49a3-45b0-995f-5bf708560b96 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc74-49a3-45b0-995f-5bf708560b96 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc74-49a3-45b0-995f-5bf708560b96 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc74-49a3-45b0-995f-5bf708560b96 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:30 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-1a9fdc74-49a3-45b0-995f-5bf708560b96 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1a9fdc74-49a3-45b0-995f-5bf708560b96 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531" status: 200 len: 1722 microversion: 2.1 time: 0.269128 Apr 14 03:08:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 176/525] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:08:30 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:08:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-39fce5fd-e75b-4c9a-b537-571cf5816a29 req-b41b7109-aa2e-4231-813d-54f2084b1b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1493ecb-e6a8-48c5-abf3-d3cbc092736a", "tag": "136dada7-395e-410e-8eee-03e4d82dc01a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-39fce5fd-e75b-4c9a-b537-571cf5816a29 req-b41b7109-aa2e-4231-813d-54f2084b1b72 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-39fce5fd-e75b-4c9a-b537-571cf5816a29 req-b41b7109-aa2e-4231-813d-54f2084b1b72 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-39fce5fd-e75b-4c9a-b537-571cf5816a29 req-b41b7109-aa2e-4231-813d-54f2084b1b72 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:31 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=35 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-39fce5fd-e75b-4c9a-b537-571cf5816a29 req-b41b7109-aa2e-4231-813d-54f2084b1b72 service nova] Creating event network-changed:136dada7-395e-410e-8eee-03e4d82dc01a for instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a on user Apr 14 03:08:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-39fce5fd-e75b-4c9a-b537-571cf5816a29 req-b41b7109-aa2e-4231-813d-54f2084b1b72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034619 Apr 14 03:08:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 177/526] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:31 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-8a949331-cfae-45e8-9ed0-8b6908d16ab3 req-9a9aff7a-2808-43d0-96f0-02326c6cc804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-unplugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8a949331-cfae-45e8-9ed0-8b6908d16ab3 req-9a9aff7a-2808-43d0-96f0-02326c6cc804 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8a949331-cfae-45e8-9ed0-8b6908d16ab3 req-9a9aff7a-2808-43d0-96f0-02326c6cc804 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8a949331-cfae-45e8-9ed0-8b6908d16ab3 req-9a9aff7a-2808-43d0-96f0-02326c6cc804 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:31 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8a949331-cfae-45e8-9ed0-8b6908d16ab3 req-9a9aff7a-2808-43d0-96f0-02326c6cc804 service nova] Creating event network-vif-unplugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:08:31 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-8a949331-cfae-45e8-9ed0-8b6908d16ab3 req-9a9aff7a-2808-43d0-96f0-02326c6cc804 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040412 Apr 14 03:08:31 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 174/527] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-af7da8e1-8491-400e-8aff-d23650b9f78c req-40c4dbdb-4666-4f26-ac4e-c97eda33b4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-plugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-af7da8e1-8491-400e-8aff-d23650b9f78c req-40c4dbdb-4666-4f26-ac4e-c97eda33b4fc service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-af7da8e1-8491-400e-8aff-d23650b9f78c req-40c4dbdb-4666-4f26-ac4e-c97eda33b4fc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-af7da8e1-8491-400e-8aff-d23650b9f78c req-40c4dbdb-4666-4f26-ac4e-c97eda33b4fc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-af7da8e1-8491-400e-8aff-d23650b9f78c req-40c4dbdb-4666-4f26-ac4e-c97eda33b4fc service nova] Creating event network-vif-plugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:08:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-af7da8e1-8491-400e-8aff-d23650b9f78c req-40c4dbdb-4666-4f26-ac4e-c97eda33b4fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050378 Apr 14 03:08:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 177/528] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-dfb8422e-3daa-44d9-a5db-92a2cc2fce42 req-1c5edb1d-c8f4-4a94-90dd-f3f4453c34a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1493ecb-e6a8-48c5-abf3-d3cbc092736a", "name": "network-vif-plugged", "status": "completed", "tag": "136dada7-395e-410e-8eee-03e4d82dc01a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-dfb8422e-3daa-44d9-a5db-92a2cc2fce42 req-1c5edb1d-c8f4-4a94-90dd-f3f4453c34a1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-dfb8422e-3daa-44d9-a5db-92a2cc2fce42 req-1c5edb1d-c8f4-4a94-90dd-f3f4453c34a1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-dfb8422e-3daa-44d9-a5db-92a2cc2fce42 req-1c5edb1d-c8f4-4a94-90dd-f3f4453c34a1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-dfb8422e-3daa-44d9-a5db-92a2cc2fce42 req-1c5edb1d-c8f4-4a94-90dd-f3f4453c34a1 service nova] Creating event network-vif-plugged:136dada7-395e-410e-8eee-03e4d82dc01a for instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a on user Apr 14 03:08:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-dfb8422e-3daa-44d9-a5db-92a2cc2fce42 req-1c5edb1d-c8f4-4a94-90dd-f3f4453c34a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039783 Apr 14 03:08:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 178/529] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-14e0d7c9-7780-40c9-91e8-777cc010343d req-6a5cea7d-e752-4c35-a484-976cb2b384d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-plugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-14e0d7c9-7780-40c9-91e8-777cc010343d req-6a5cea7d-e752-4c35-a484-976cb2b384d9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-14e0d7c9-7780-40c9-91e8-777cc010343d req-6a5cea7d-e752-4c35-a484-976cb2b384d9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-14e0d7c9-7780-40c9-91e8-777cc010343d req-6a5cea7d-e752-4c35-a484-976cb2b384d9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:36 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-14e0d7c9-7780-40c9-91e8-777cc010343d req-6a5cea7d-e752-4c35-a484-976cb2b384d9 service nova] Creating event network-vif-plugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:08:36 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-14e0d7c9-7780-40c9-91e8-777cc010343d req-6a5cea7d-e752-4c35-a484-976cb2b384d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032340 Apr 14 03:08:36 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 175/530] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-28170ef6-bf61-4ca8-a3cc-fb8f7f995ea0 req-1244bfb0-86e4-4975-bc29-33279907863d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1493ecb-e6a8-48c5-abf3-d3cbc092736a", "name": "network-vif-plugged", "status": "completed", "tag": "136dada7-395e-410e-8eee-03e4d82dc01a"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-28170ef6-bf61-4ca8-a3cc-fb8f7f995ea0 req-1244bfb0-86e4-4975-bc29-33279907863d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-28170ef6-bf61-4ca8-a3cc-fb8f7f995ea0 req-1244bfb0-86e4-4975-bc29-33279907863d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-28170ef6-bf61-4ca8-a3cc-fb8f7f995ea0 req-1244bfb0-86e4-4975-bc29-33279907863d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-28170ef6-bf61-4ca8-a3cc-fb8f7f995ea0 req-1244bfb0-86e4-4975-bc29-33279907863d service nova] Creating event network-vif-plugged:136dada7-395e-410e-8eee-03e4d82dc01a for instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a on user Apr 14 03:08:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-28170ef6-bf61-4ca8-a3cc-fb8f7f995ea0 req-1244bfb0-86e4-4975-bc29-33279907863d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036213 Apr 14 03:08:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 178/531] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-e37de553-3691-4fff-9ad9-abfe2399eec2 req-4b2e82c9-7e6c-42ea-9e27-b953f3fb449c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-plugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e37de553-3691-4fff-9ad9-abfe2399eec2 req-4b2e82c9-7e6c-42ea-9e27-b953f3fb449c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e37de553-3691-4fff-9ad9-abfe2399eec2 req-4b2e82c9-7e6c-42ea-9e27-b953f3fb449c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e37de553-3691-4fff-9ad9-abfe2399eec2 req-4b2e82c9-7e6c-42ea-9e27-b953f3fb449c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e37de553-3691-4fff-9ad9-abfe2399eec2 req-4b2e82c9-7e6c-42ea-9e27-b953f3fb449c service nova] Creating event network-vif-plugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:08:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-e37de553-3691-4fff-9ad9-abfe2399eec2 req-4b2e82c9-7e6c-42ea-9e27-b953f3fb449c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041967 Apr 14 03:08:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 179/532] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:38 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fd47067f-0779-4dc4-9147-3c95c7c98e59 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:38 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-fd47067f-0779-4dc4-9147-3c95c7c98e59 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd47067f-0779-4dc4-9147-3c95c7c98e59 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd47067f-0779-4dc4-9147-3c95c7c98e59 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd47067f-0779-4dc4-9147-3c95c7c98e59 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd47067f-0779-4dc4-9147-3c95c7c98e59 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd47067f-0779-4dc4-9147-3c95c7c98e59 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd47067f-0779-4dc4-9147-3c95c7c98e59 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-fd47067f-0779-4dc4-9147-3c95c7c98e59 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/action" status: 202 len: 0 microversion: 2.1 time: 0.177706 Apr 14 03:08:38 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 176/533] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:08:38 2023] POST /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=12 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b38f5a61-9bdf-4142-91b5-6e9493a5967f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b38f5a61-9bdf-4142-91b5-6e9493a5967f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b38f5a61-9bdf-4142-91b5-6e9493a5967f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b38f5a61-9bdf-4142-91b5-6e9493a5967f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b38f5a61-9bdf-4142-91b5-6e9493a5967f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b38f5a61-9bdf-4142-91b5-6e9493a5967f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b38f5a61-9bdf-4142-91b5-6e9493a5967f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b38f5a61-9bdf-4142-91b5-6e9493a5967f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:38 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b38f5a61-9bdf-4142-91b5-6e9493a5967f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b38f5a61-9bdf-4142-91b5-6e9493a5967f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1728 microversion: 2.1 time: 0.183509 Apr 14 03:08:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 179/534] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:08:38 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:08:39 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-22c1ed7b-fa3a-46b7-8d8b-3de0956f9ddc tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-22c1ed7b-fa3a-46b7-8d8b-3de0956f9ddc tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-22c1ed7b-fa3a-46b7-8d8b-3de0956f9ddc tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-22c1ed7b-fa3a-46b7-8d8b-3de0956f9ddc tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-22c1ed7b-fa3a-46b7-8d8b-3de0956f9ddc tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-22c1ed7b-fa3a-46b7-8d8b-3de0956f9ddc tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-22c1ed7b-fa3a-46b7-8d8b-3de0956f9ddc tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-22c1ed7b-fa3a-46b7-8d8b-3de0956f9ddc tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-22c1ed7b-fa3a-46b7-8d8b-3de0956f9ddc tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.198705 Apr 14 03:08:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 180/535] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 03:08:39 2023] GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93/os-interface => generated 1831 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:08:40 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-73710fdc-97f7-48c1-a4f0-f7f678e2367c req-d9081cf2-d838-4137-b006-13ea5a1cb739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-unplugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-73710fdc-97f7-48c1-a4f0-f7f678e2367c req-d9081cf2-d838-4137-b006-13ea5a1cb739 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-73710fdc-97f7-48c1-a4f0-f7f678e2367c req-d9081cf2-d838-4137-b006-13ea5a1cb739 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-73710fdc-97f7-48c1-a4f0-f7f678e2367c req-d9081cf2-d838-4137-b006-13ea5a1cb739 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-73710fdc-97f7-48c1-a4f0-f7f678e2367c req-d9081cf2-d838-4137-b006-13ea5a1cb739 service nova] Creating event network-vif-unplugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:08:40 user devstack@n-api.service[61662]: DEBUG nova.compute.api [req-73710fdc-97f7-48c1-a4f0-f7f678e2367c req-d9081cf2-d838-4137-b006-13ea5a1cb739 service nova] Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61662) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:08:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-73710fdc-97f7-48c1-a4f0-f7f678e2367c req-d9081cf2-d838-4137-b006-13ea5a1cb739 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069209 Apr 14 03:08:40 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 177/536] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:08:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-c5bfd495-3b47-4cf0-a888-66d880018ee4 req-646a2806-7f30-4342-a2ee-3688b3c9989f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "tag": "2e49423b-86d6-4b5a-b9cf-321ee37937c3"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c5bfd495-3b47-4cf0-a888-66d880018ee4 req-646a2806-7f30-4342-a2ee-3688b3c9989f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c5bfd495-3b47-4cf0-a888-66d880018ee4 req-646a2806-7f30-4342-a2ee-3688b3c9989f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c5bfd495-3b47-4cf0-a888-66d880018ee4 req-646a2806-7f30-4342-a2ee-3688b3c9989f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c5bfd495-3b47-4cf0-a888-66d880018ee4 req-646a2806-7f30-4342-a2ee-3688b3c9989f service nova] Creating event network-changed:2e49423b-86d6-4b5a-b9cf-321ee37937c3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-c5bfd495-3b47-4cf0-a888-66d880018ee4 req-646a2806-7f30-4342-a2ee-3688b3c9989f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034490 Apr 14 03:08:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 180/537] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:40 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:41 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:41 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:41 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ad74d35a-7800-490b-a201-ec93d3f9dc0e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93" status: 200 len: 2831 microversion: 2.42 time: 0.360150 Apr 14 03:08:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 181/538] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:08:40 2023] GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 => generated 2831 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:08:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-908422ff-bcb3-47e1-adc0-267f230d23f3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:41 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-908422ff-bcb3-47e1-adc0-267f230d23f3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908422ff-bcb3-47e1-adc0-267f230d23f3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908422ff-bcb3-47e1-adc0-267f230d23f3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908422ff-bcb3-47e1-adc0-267f230d23f3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908422ff-bcb3-47e1-adc0-267f230d23f3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908422ff-bcb3-47e1-adc0-267f230d23f3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-908422ff-bcb3-47e1-adc0-267f230d23f3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-908422ff-bcb3-47e1-adc0-267f230d23f3 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.174737 Apr 14 03:08:41 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 178/539] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 03:08:41 2023] GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93/os-interface => generated 1831 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:08:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-04d455f9-cbf7-4fa3-a446-f755f0466d0c req-f2c8a18d-7844-41e0-8f2e-2412a46c2580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-04d455f9-cbf7-4fa3-a446-f755f0466d0c req-f2c8a18d-7844-41e0-8f2e-2412a46c2580 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-04d455f9-cbf7-4fa3-a446-f755f0466d0c req-f2c8a18d-7844-41e0-8f2e-2412a46c2580 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-04d455f9-cbf7-4fa3-a446-f755f0466d0c req-f2c8a18d-7844-41e0-8f2e-2412a46c2580 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-04d455f9-cbf7-4fa3-a446-f755f0466d0c req-f2c8a18d-7844-41e0-8f2e-2412a46c2580 service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:08:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [req-04d455f9-cbf7-4fa3-a446-f755f0466d0c req-f2c8a18d-7844-41e0-8f2e-2412a46c2580 service nova] Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61664) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:08:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-04d455f9-cbf7-4fa3-a446-f755f0466d0c req-f2c8a18d-7844-41e0-8f2e-2412a46c2580 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050414 Apr 14 03:08:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 181/540] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d7233161-c817-44fc-9ade-798939881a93 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d7233161-c817-44fc-9ade-798939881a93 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d7233161-c817-44fc-9ade-798939881a93 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d7233161-c817-44fc-9ade-798939881a93 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d7233161-c817-44fc-9ade-798939881a93 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d7233161-c817-44fc-9ade-798939881a93 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d7233161-c817-44fc-9ade-798939881a93 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d7233161-c817-44fc-9ade-798939881a93 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d7233161-c817-44fc-9ade-798939881a93 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:08:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d7233161-c817-44fc-9ade-798939881a93 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93" status: 204 len: 0 microversion: 2.42 time: 0.164886 Apr 14 03:08:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 182/541] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:08:42 2023] DELETE /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:08:42 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:42 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:43 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:43 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:43 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a311491e2924c49b01fd42458ec2fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d531e7f7004ebaa529cb60de3849e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-fee66adb-886f-4f4a-8064-7a9efc996b40 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93" status: 200 len: 2955 microversion: 2.42 time: 0.332363 Apr 14 03:08:43 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 179/542] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:08:42 2023] GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 => generated 2955 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:08:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-642a7bcc-f28e-4235-b46f-21381469c322 req-63bb5aeb-8905-4b2f-ab5d-269470a8935a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-unplugged", "status": "completed", "tag": "2e49423b-86d6-4b5a-b9cf-321ee37937c3"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-642a7bcc-f28e-4235-b46f-21381469c322 req-63bb5aeb-8905-4b2f-ab5d-269470a8935a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-642a7bcc-f28e-4235-b46f-21381469c322 req-63bb5aeb-8905-4b2f-ab5d-269470a8935a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-642a7bcc-f28e-4235-b46f-21381469c322 req-63bb5aeb-8905-4b2f-ab5d-269470a8935a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-642a7bcc-f28e-4235-b46f-21381469c322 req-63bb5aeb-8905-4b2f-ab5d-269470a8935a service nova] Creating event network-vif-unplugged:2e49423b-86d6-4b5a-b9cf-321ee37937c3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-642a7bcc-f28e-4235-b46f-21381469c322 req-63bb5aeb-8905-4b2f-ab5d-269470a8935a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.266485 Apr 14 03:08:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 182/543] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-bf5b0cd7-8770-4117-9d8b-314a27209ae5 req-a54c5959-e7d6-4912-98c5-6032045f3714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-unplugged", "status": "completed", "tag": "0a6ecbf1-8127-469a-92cc-5b4673e3db51"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "0a6ecbf1-8127-469a-92cc-5b4673e3db51"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-unplugged", "status": "completed", "tag": "dd090320-de86-40c8-bafb-515fa9c628e3"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "dd090320-de86-40c8-bafb-515fa9c628e3"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-bf5b0cd7-8770-4117-9d8b-314a27209ae5 req-a54c5959-e7d6-4912-98c5-6032045f3714 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-bf5b0cd7-8770-4117-9d8b-314a27209ae5 req-a54c5959-e7d6-4912-98c5-6032045f3714 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-bf5b0cd7-8770-4117-9d8b-314a27209ae5 req-a54c5959-e7d6-4912-98c5-6032045f3714 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-bf5b0cd7-8770-4117-9d8b-314a27209ae5 req-a54c5959-e7d6-4912-98c5-6032045f3714 service nova] Creating event network-vif-unplugged:0a6ecbf1-8127-469a-92cc-5b4673e3db51 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-bf5b0cd7-8770-4117-9d8b-314a27209ae5 req-a54c5959-e7d6-4912-98c5-6032045f3714 service nova] Creating event network-vif-plugged:0a6ecbf1-8127-469a-92cc-5b4673e3db51 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-bf5b0cd7-8770-4117-9d8b-314a27209ae5 req-a54c5959-e7d6-4912-98c5-6032045f3714 service nova] Creating event network-vif-unplugged:dd090320-de86-40c8-bafb-515fa9c628e3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-bf5b0cd7-8770-4117-9d8b-314a27209ae5 req-a54c5959-e7d6-4912-98c5-6032045f3714 service nova] Creating event network-vif-plugged:dd090320-de86-40c8-bafb-515fa9c628e3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-bf5b0cd7-8770-4117-9d8b-314a27209ae5 req-a54c5959-e7d6-4912-98c5-6032045f3714 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.072916 Apr 14 03:08:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 183/544] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:44 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:45 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "2e49423b-86d6-4b5a-b9cf-321ee37937c3"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-unplugged", "status": "completed", "tag": "dbeb1c70-267b-4fde-b1a5-0e3567a11489"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "dbeb1c70-267b-4fde-b1a5-0e3567a11489"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-unplugged", "status": "completed", "tag": "98ba28ec-b77c-4a23-b003-a4d29371cf95"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "98ba28ec-b77c-4a23-b003-a4d29371cf95"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-unplugged", "status": "completed", "tag": "6691f178-7199-44c1-9dd7-049cf205185b"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "6691f178-7199-44c1-9dd7-049cf205185b"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:46 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Creating event network-vif-plugged:2e49423b-86d6-4b5a-b9cf-321ee37937c3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Creating event network-vif-unplugged:dbeb1c70-267b-4fde-b1a5-0e3567a11489 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Creating event network-vif-plugged:dbeb1c70-267b-4fde-b1a5-0e3567a11489 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Creating event network-vif-unplugged:98ba28ec-b77c-4a23-b003-a4d29371cf95 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Creating event network-vif-plugged:98ba28ec-b77c-4a23-b003-a4d29371cf95 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Creating event network-vif-unplugged:6691f178-7199-44c1-9dd7-049cf205185b for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] Creating event network-vif-plugged:6691f178-7199-44c1-9dd7-049cf205185b for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-8735b309-29f2-419e-a179-00de00ad3ddb req-f7bacd56-88d2-40ca-a913-d56c9d8c8420 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.080461 Apr 14 03:08:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 180/545] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 03:08:45 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:08:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:47 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-f0624beb-0174-4720-bd5e-5a3be9895ee3 req-501f86c2-4d58-4cb1-8dee-3d95ccf406a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-unplugged", "status": "completed", "tag": "093349f3-a544-487d-9927-f75c63ac2e9c"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-plugged", "status": "completed", "tag": "093349f3-a544-487d-9927-f75c63ac2e9c"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f0624beb-0174-4720-bd5e-5a3be9895ee3 req-501f86c2-4d58-4cb1-8dee-3d95ccf406a3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f0624beb-0174-4720-bd5e-5a3be9895ee3 req-501f86c2-4d58-4cb1-8dee-3d95ccf406a3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f0624beb-0174-4720-bd5e-5a3be9895ee3 req-501f86c2-4d58-4cb1-8dee-3d95ccf406a3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f0624beb-0174-4720-bd5e-5a3be9895ee3 req-501f86c2-4d58-4cb1-8dee-3d95ccf406a3 service nova] Creating event network-vif-unplugged:093349f3-a544-487d-9927-f75c63ac2e9c for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f0624beb-0174-4720-bd5e-5a3be9895ee3 req-501f86c2-4d58-4cb1-8dee-3d95ccf406a3 service nova] Creating event network-vif-plugged:093349f3-a544-487d-9927-f75c63ac2e9c for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-f0624beb-0174-4720-bd5e-5a3be9895ee3 req-501f86c2-4d58-4cb1-8dee-3d95ccf406a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.062461 Apr 14 03:08:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 184/546] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:48 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:48 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:48 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:48 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-bf1bb741-f476-4397-b6a2-6dd68441d540 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a" status: 200 len: 1770 microversion: 2.87 time: 0.203822 Apr 14 03:08:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 183/547] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:08:47 2023] GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a => generated 1770 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:08:50 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-2e3ea74f-c250-4d8b-b4f7-623decc7660d req-d0242dcb-3fb5-48b2-bb96-893b4a9a334d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-deleted", "tag": "2e49423b-86d6-4b5a-b9cf-321ee37937c3"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-deleted", "tag": "dd090320-de86-40c8-bafb-515fa9c628e3"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-deleted", "tag": "6691f178-7199-44c1-9dd7-049cf205185b"}, {"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-deleted", "tag": "98ba28ec-b77c-4a23-b003-a4d29371cf95"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-2e3ea74f-c250-4d8b-b4f7-623decc7660d req-d0242dcb-3fb5-48b2-bb96-893b4a9a334d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-2e3ea74f-c250-4d8b-b4f7-623decc7660d req-d0242dcb-3fb5-48b2-bb96-893b4a9a334d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-2e3ea74f-c250-4d8b-b4f7-623decc7660d req-d0242dcb-3fb5-48b2-bb96-893b4a9a334d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-2e3ea74f-c250-4d8b-b4f7-623decc7660d req-d0242dcb-3fb5-48b2-bb96-893b4a9a334d service nova] Creating event network-vif-deleted:2e49423b-86d6-4b5a-b9cf-321ee37937c3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-2e3ea74f-c250-4d8b-b4f7-623decc7660d req-d0242dcb-3fb5-48b2-bb96-893b4a9a334d service nova] Creating event network-vif-deleted:dd090320-de86-40c8-bafb-515fa9c628e3 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-2e3ea74f-c250-4d8b-b4f7-623decc7660d req-d0242dcb-3fb5-48b2-bb96-893b4a9a334d service nova] Creating event network-vif-deleted:6691f178-7199-44c1-9dd7-049cf205185b for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-2e3ea74f-c250-4d8b-b4f7-623decc7660d req-d0242dcb-3fb5-48b2-bb96-893b4a9a334d service nova] Creating event network-vif-deleted:98ba28ec-b77c-4a23-b003-a4d29371cf95 for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-2e3ea74f-c250-4d8b-b4f7-623decc7660d req-d0242dcb-3fb5-48b2-bb96-893b4a9a334d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.044986 Apr 14 03:08:50 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 181/548] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:50 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-7feaed1e-1e7a-492b-bfbd-e170f73ed2a4 req-852cd712-dc53-4115-9185-445a46d626c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29366fd0-eee1-4eb2-921a-c46b9677cc93", "name": "network-vif-deleted", "tag": "093349f3-a544-487d-9927-f75c63ac2e9c"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7feaed1e-1e7a-492b-bfbd-e170f73ed2a4 req-852cd712-dc53-4115-9185-445a46d626c1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7feaed1e-1e7a-492b-bfbd-e170f73ed2a4 req-852cd712-dc53-4115-9185-445a46d626c1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7feaed1e-1e7a-492b-bfbd-e170f73ed2a4 req-852cd712-dc53-4115-9185-445a46d626c1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-7feaed1e-1e7a-492b-bfbd-e170f73ed2a4 req-852cd712-dc53-4115-9185-445a46d626c1 service nova] Creating event network-vif-deleted:093349f3-a544-487d-9927-f75c63ac2e9c for instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 on user Apr 14 03:08:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-7feaed1e-1e7a-492b-bfbd-e170f73ed2a4 req-852cd712-dc53-4115-9185-445a46d626c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033999 Apr 14 03:08:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 185/549] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-c73f11a0-2a14-41ab-a84f-597cdb102882 req-cc0c0834-6a9a-4d9f-b401-61907a51def0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c73f11a0-2a14-41ab-a84f-597cdb102882 req-cc0c0834-6a9a-4d9f-b401-61907a51def0 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c73f11a0-2a14-41ab-a84f-597cdb102882 req-cc0c0834-6a9a-4d9f-b401-61907a51def0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c73f11a0-2a14-41ab-a84f-597cdb102882 req-cc0c0834-6a9a-4d9f-b401-61907a51def0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:53 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c73f11a0-2a14-41ab-a84f-597cdb102882 req-cc0c0834-6a9a-4d9f-b401-61907a51def0 service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:08:53 user devstack@n-api.service[61664]: DEBUG nova.compute.api [req-c73f11a0-2a14-41ab-a84f-597cdb102882 req-cc0c0834-6a9a-4d9f-b401-61907a51def0 service nova] Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61664) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:08:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-c73f11a0-2a14-41ab-a84f-597cdb102882 req-cc0c0834-6a9a-4d9f-b401-61907a51def0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046286 Apr 14 03:08:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 184/550] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-c488783d-bdc6-4e06-aa1b-0ccb9291d037 req-0a6bf4c4-1ac1-4cd8-81aa-1db5d734c65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:08:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c488783d-bdc6-4e06-aa1b-0ccb9291d037 req-0a6bf4c4-1ac1-4cd8-81aa-1db5d734c65d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c488783d-bdc6-4e06-aa1b-0ccb9291d037 req-0a6bf4c4-1ac1-4cd8-81aa-1db5d734c65d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c488783d-bdc6-4e06-aa1b-0ccb9291d037 req-0a6bf4c4-1ac1-4cd8-81aa-1db5d734c65d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-c488783d-bdc6-4e06-aa1b-0ccb9291d037 req-0a6bf4c4-1ac1-4cd8-81aa-1db5d734c65d service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:08:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-c488783d-bdc6-4e06-aa1b-0ccb9291d037 req-0a6bf4c4-1ac1-4cd8-81aa-1db5d734c65d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 Apr 14 03:08:55 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 182/551] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:08:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:08:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4f7a25fb-70a0-4288-a9ef-6769bacb5848 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:08:55 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4f7a25fb-70a0-4288-a9ef-6769bacb5848 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7a1e2563-0dc3-4cc9-aa61-7cb321f28622] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:08:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f7a25fb-70a0-4288-a9ef-6769bacb5848 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f7a25fb-70a0-4288-a9ef-6769bacb5848 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f7a25fb-70a0-4288-a9ef-6769bacb5848 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f7a25fb-70a0-4288-a9ef-6769bacb5848 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:08:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f7a25fb-70a0-4288-a9ef-6769bacb5848 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:08:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f7a25fb-70a0-4288-a9ef-6769bacb5848 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:08:55 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4f7a25fb-70a0-4288-a9ef-6769bacb5848 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:08:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4f7a25fb-70a0-4288-a9ef-6769bacb5848 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622" status: 200 len: 1443 microversion: 2.1 time: 0.165707 Apr 14 03:08:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 186/552] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:08:55 2023] GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=19 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2d48288f-f5c5-42e9-bffc-1158732f7aad tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2d48288f-f5c5-42e9-bffc-1158732f7aad tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d48288f-f5c5-42e9-bffc-1158732f7aad tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d48288f-f5c5-42e9-bffc-1158732f7aad tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d48288f-f5c5-42e9-bffc-1158732f7aad tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d48288f-f5c5-42e9-bffc-1158732f7aad tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d48288f-f5c5-42e9-bffc-1158732f7aad tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d48288f-f5c5-42e9-bffc-1158732f7aad tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:08 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-2d48288f-f5c5-42e9-bffc-1158732f7aad tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:09:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2d48288f-f5c5-42e9-bffc-1158732f7aad tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d" status: 200 len: 1535 microversion: 2.1 time: 0.265445 Apr 14 03:09:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 185/553] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:09:08 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d => generated 1535 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:09:11 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:11 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:11 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:12 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=5 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] HTTP exception thrown: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:12 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Request method failure captured: Apr 14 03:09:12 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a HTTP/1.1 Apr 14 03:09:12 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:09:12 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:09:12 user devstack@n-api.service[61662]: Connection: close Apr 14 03:09:12 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:09:12 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:09:12 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:09:12 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:09:12 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMLjkzqVhdwZyKB-NXVWxeYKLpNhJNMnxTM_qVUVJsHbX8iFUm3cB1uAeGsz6MzgH8ZY-JZAO9FCVxuZETaTQLtMWIokpOKdHoU9c1KFzUy1xu9hLLH30zyHS-hZRr390n7FrQ4qszNDi1R8m3tzCPCtHY2fzZFm0dsOBH6krb-3h90 Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Project-Id: 6a991a4fd13b4a819b24479a341ba08c Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Project-Name: tempest-TaggedAttachmentsTest-1835109148 Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a991a4fd13b4a819b24479a341ba08c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a991a4fd13b4a819b24479a341ba08c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a991a4fd13b4a819b24479a341ba08c"}]}] Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Tenant: tempest-TaggedAttachmentsTest-1835109148 Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Tenant-Id: 6a991a4fd13b4a819b24479a341ba08c Apr 14 03:09:12 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1835109148 Apr 14 03:09:12 user devstack@n-api.service[61662]: X-User: tempest-TaggedAttachmentsTest-1835109148-project-member Apr 14 03:09:12 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:09:12 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:09:12 user devstack@n-api.service[61662]: X-User-Id: 17999fdd4eb449d49d74b4de20f6614a Apr 14 03:09:12 user devstack@n-api.service[61662]: X-User-Name: tempest-TaggedAttachmentsTest-1835109148-project-member Apr 14 03:09:12 user devstack@n-api.service[61662]: method: > Apr 14 03:09:12 user devstack@n-api.service[61662]: exception: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:12 user devstack@n-api.service[61662]: action_args: {'id': '3e73add1-26be-47dd-adc5-506ab517544a'} Apr 14 03:09:12 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:12 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:12 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Returning 404 to user: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:09:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-fbdd7fb8-a4c6-4197-a258-7131384fdcfc tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a" status: 404 len: 111 microversion: 2.49 time: 0.094943 Apr 14 03:09:12 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 183/554] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:09:11 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:09:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0c50f6d1-8870-41d7-8b6f-95dfc66fcbda tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '.version_select at 0x7ff11a4e0dc0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:12 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:12 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0c50f6d1-8870-41d7-8b6f-95dfc66fcbda tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544638969" status: 204 len: 0 microversion: 2.49 time: 0.029607 Apr 14 03:09:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 187/555] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 03:09:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544638969 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:09:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:14 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] HTTP exception thrown: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Request method failure captured: Apr 14 03:09:14 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a HTTP/1.1 Apr 14 03:09:14 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:09:14 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:09:14 user devstack@n-api.service[61664]: Connection: close Apr 14 03:09:14 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:09:14 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:09:14 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:09:14 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:09:14 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMLjkzqVhdwZyKB-NXVWxeYKLpNhJNMnxTM_qVUVJsHbX8iFUm3cB1uAeGsz6MzgH8ZY-JZAO9FCVxuZETaTQLtMWIokpOKdHoU9c1KFzUy1xu9hLLH30zyHS-hZRr390n7FrQ4qszNDi1R8m3tzCPCtHY2fzZFm0dsOBH6krb-3h90 Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Project-Id: 6a991a4fd13b4a819b24479a341ba08c Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Project-Name: tempest-TaggedAttachmentsTest-1835109148 Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a991a4fd13b4a819b24479a341ba08c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a991a4fd13b4a819b24479a341ba08c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a991a4fd13b4a819b24479a341ba08c"}]}] Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Tenant: tempest-TaggedAttachmentsTest-1835109148 Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Tenant-Id: 6a991a4fd13b4a819b24479a341ba08c Apr 14 03:09:14 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1835109148 Apr 14 03:09:14 user devstack@n-api.service[61664]: X-User: tempest-TaggedAttachmentsTest-1835109148-project-member Apr 14 03:09:14 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:09:14 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:09:14 user devstack@n-api.service[61664]: X-User-Id: 17999fdd4eb449d49d74b4de20f6614a Apr 14 03:09:14 user devstack@n-api.service[61664]: X-User-Name: tempest-TaggedAttachmentsTest-1835109148-project-member Apr 14 03:09:14 user devstack@n-api.service[61664]: method: > Apr 14 03:09:14 user devstack@n-api.service[61664]: exception: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:14 user devstack@n-api.service[61664]: action_args: {'id': '3e73add1-26be-47dd-adc5-506ab517544a'} Apr 14 03:09:14 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:14 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:09:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Returning 404 to user: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:09:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b33c6093-434d-4813-a7e2-b7efc874f53d tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a" status: 404 len: 111 microversion: 2.49 time: 0.032494 Apr 14 03:09:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 186/556] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:09:14 2023] DELETE /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:09:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:14 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] [instance: 3e73add1-26be-47dd-adc5-506ab517544a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] HTTP exception thrown: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Request method failure captured: Apr 14 03:09:14 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a HTTP/1.1 Apr 14 03:09:14 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:09:14 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:09:14 user devstack@n-api.service[61662]: Connection: close Apr 14 03:09:14 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:09:14 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:09:14 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:09:14 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:09:14 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMLjkzqVhdwZyKB-NXVWxeYKLpNhJNMnxTM_qVUVJsHbX8iFUm3cB1uAeGsz6MzgH8ZY-JZAO9FCVxuZETaTQLtMWIokpOKdHoU9c1KFzUy1xu9hLLH30zyHS-hZRr390n7FrQ4qszNDi1R8m3tzCPCtHY2fzZFm0dsOBH6krb-3h90 Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Project-Id: 6a991a4fd13b4a819b24479a341ba08c Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Project-Name: tempest-TaggedAttachmentsTest-1835109148 Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a991a4fd13b4a819b24479a341ba08c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a991a4fd13b4a819b24479a341ba08c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a991a4fd13b4a819b24479a341ba08c"}]}] Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Tenant: tempest-TaggedAttachmentsTest-1835109148 Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Tenant-Id: 6a991a4fd13b4a819b24479a341ba08c Apr 14 03:09:14 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1835109148 Apr 14 03:09:14 user devstack@n-api.service[61662]: X-User: tempest-TaggedAttachmentsTest-1835109148-project-member Apr 14 03:09:14 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:09:14 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:09:14 user devstack@n-api.service[61662]: X-User-Id: 17999fdd4eb449d49d74b4de20f6614a Apr 14 03:09:14 user devstack@n-api.service[61662]: X-User-Name: tempest-TaggedAttachmentsTest-1835109148-project-member Apr 14 03:09:14 user devstack@n-api.service[61662]: method: > Apr 14 03:09:14 user devstack@n-api.service[61662]: exception: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:14 user devstack@n-api.service[61662]: action_args: {'id': '3e73add1-26be-47dd-adc5-506ab517544a'} Apr 14 03:09:14 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. Apr 14 03:09:14 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] Returning 404 to user: Instance 3e73add1-26be-47dd-adc5-506ab517544a could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:09:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-1db2e63a-d81b-4b27-b588-5f903d90b9b3 tempest-TaggedAttachmentsTest-1835109148 tempest-TaggedAttachmentsTest-1835109148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a" status: 404 len: 111 microversion: 2.49 time: 0.038418 Apr 14 03:09:14 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 184/557] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:09:14 2023] GET /compute/v2.1/servers/3e73add1-26be-47dd-adc5-506ab517544a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:09:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-82f7a5d6-6ff5-4c5c-86ef-9946ff40c2ca tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:18 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-82f7a5d6-6ff5-4c5c-86ef-9946ff40c2ca tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: e1493ecb-e6a8-48c5-abf3-d3cbc092736a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82f7a5d6-6ff5-4c5c-86ef-9946ff40c2ca tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82f7a5d6-6ff5-4c5c-86ef-9946ff40c2ca tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82f7a5d6-6ff5-4c5c-86ef-9946ff40c2ca tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82f7a5d6-6ff5-4c5c-86ef-9946ff40c2ca tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82f7a5d6-6ff5-4c5c-86ef-9946ff40c2ca tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82f7a5d6-6ff5-4c5c-86ef-9946ff40c2ca tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:18 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-82f7a5d6-6ff5-4c5c-86ef-9946ff40c2ca tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0128a733bd6a4120addba5eda1cc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4549f6080dcf4c739ac03ef643801fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:09:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-82f7a5d6-6ff5-4c5c-86ef-9946ff40c2ca tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a" status: 200 len: 1495 microversion: 2.1 time: 0.158257 Apr 14 03:09:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 188/558] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:09:18 2023] GET /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a => generated 1495 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:09:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-71c24022-4537-49e3-940b-4033afb3f143 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:21 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-71c24022-4537-49e3-940b-4033afb3f143 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-71c24022-4537-49e3-940b-4033afb3f143 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-71c24022-4537-49e3-940b-4033afb3f143 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-71c24022-4537-49e3-940b-4033afb3f143 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-71c24022-4537-49e3-940b-4033afb3f143 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-71c24022-4537-49e3-940b-4033afb3f143 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-71c24022-4537-49e3-940b-4033afb3f143 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:21 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-71c24022-4537-49e3-940b-4033afb3f143 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:09:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-71c24022-4537-49e3-940b-4033afb3f143 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531" status: 200 len: 1702 microversion: 2.1 time: 0.440852 Apr 14 03:09:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 187/559] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:09:21 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531 => generated 1702 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d0222e2c-eece-4371-a6e5-94f649f31a77 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d0222e2c-eece-4371-a6e5-94f649f31a77 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d0222e2c-eece-4371-a6e5-94f649f31a77 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d0222e2c-eece-4371-a6e5-94f649f31a77 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d0222e2c-eece-4371-a6e5-94f649f31a77 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d0222e2c-eece-4371-a6e5-94f649f31a77 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d0222e2c-eece-4371-a6e5-94f649f31a77 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d0222e2c-eece-4371-a6e5-94f649f31a77 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:29 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-d0222e2c-eece-4371-a6e5-94f649f31a77 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:09:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d0222e2c-eece-4371-a6e5-94f649f31a77 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1721 microversion: 2.1 time: 0.183952 Apr 14 03:09:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 185/560] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:09:29 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] HTTP exception thrown: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Request method failure captured: Apr 14 03:09:33 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 HTTP/1.1 Apr 14 03:09:33 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:09:33 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:09:33 user devstack@n-api.service[61663]: Connection: close Apr 14 03:09:33 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:09:33 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:09:33 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:09:33 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:09:33 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMMvnsqNsgssKRP_X77XYCUhGiF3IXpVd-WRqG-TNZdIwQBO0H2ctAVHRgEVJcSGzj-6NBxC822Dm-AQRmDp2TcJIqMNVgcIETuNZ_e6LpbmPkoOS0q4qssh60WI_09Vtnq-NgVZ4QpMN2zlG9u4fHTFUuwWVVULvhQMmR2XHnc6Nhw Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Project-Id: f1d531e7f7004ebaa529cb60de3849e7 Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-641324897 Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1d531e7f7004ebaa529cb60de3849e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1d531e7f7004ebaa529cb60de3849e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1d531e7f7004ebaa529cb60de3849e7"}]}] Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Tenant: tempest-TaggedBootDevicesTest_v242-641324897 Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Tenant-Id: f1d531e7f7004ebaa529cb60de3849e7 Apr 14 03:09:33 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-641324897 Apr 14 03:09:33 user devstack@n-api.service[61663]: X-User: tempest-TaggedBootDevicesTest_v242-641324897-project-member Apr 14 03:09:33 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:09:33 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:09:33 user devstack@n-api.service[61663]: X-User-Id: 5a311491e2924c49b01fd42458ec2fc2 Apr 14 03:09:33 user devstack@n-api.service[61663]: X-User-Name: tempest-TaggedBootDevicesTest_v242-641324897-project-member Apr 14 03:09:33 user devstack@n-api.service[61663]: method: > Apr 14 03:09:33 user devstack@n-api.service[61663]: exception: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:33 user devstack@n-api.service[61663]: action_args: {'id': '29366fd0-eee1-4eb2-921a-c46b9677cc93'} Apr 14 03:09:33 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:09:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Returning 404 to user: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:09:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-418b3fc8-69e2-428e-8b90-17cd82c49774 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93" status: 404 len: 111 microversion: 2.42 time: 0.046980 Apr 14 03:09:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 189/561] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:09:33 2023] GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:09:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1f55e0e3-1c7e-4064-88fd-0032585b83be tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '.version_select at 0x7ff100730ca0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:33 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:33 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=14 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1f55e0e3-1c7e-4064-88fd-0032585b83be tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-125552723" status: 204 len: 0 microversion: 2.42 time: 0.044655 Apr 14 03:09:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 188/562] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 03:09:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-125552723 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:09:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:37 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] HTTP exception thrown: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Request method failure captured: Apr 14 03:09:37 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 HTTP/1.1 Apr 14 03:09:37 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:09:37 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:09:37 user devstack@n-api.service[61662]: Connection: close Apr 14 03:09:37 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:09:37 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:09:37 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:09:37 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:09:37 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMMvnsqNsgssKRP_X77XYCUhGiF3IXpVd-WRqG-TNZdIwQBO0H2ctAVHRgEVJcSGzj-6NBxC822Dm-AQRmDp2TcJIqMNVgcIETuNZ_e6LpbmPkoOS0q4qssh60WI_09Vtnq-NgVZ4QpMN2zlG9u4fHTFUuwWVVULvhQMmR2XHnc6Nhw Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Project-Id: f1d531e7f7004ebaa529cb60de3849e7 Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-641324897 Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1d531e7f7004ebaa529cb60de3849e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1d531e7f7004ebaa529cb60de3849e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1d531e7f7004ebaa529cb60de3849e7"}]}] Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Tenant: tempest-TaggedBootDevicesTest_v242-641324897 Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Tenant-Id: f1d531e7f7004ebaa529cb60de3849e7 Apr 14 03:09:37 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-641324897 Apr 14 03:09:37 user devstack@n-api.service[61662]: X-User: tempest-TaggedBootDevicesTest_v242-641324897-project-member Apr 14 03:09:37 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:09:37 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:09:37 user devstack@n-api.service[61662]: X-User-Id: 5a311491e2924c49b01fd42458ec2fc2 Apr 14 03:09:37 user devstack@n-api.service[61662]: X-User-Name: tempest-TaggedBootDevicesTest_v242-641324897-project-member Apr 14 03:09:37 user devstack@n-api.service[61662]: method: > Apr 14 03:09:37 user devstack@n-api.service[61662]: exception: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:37 user devstack@n-api.service[61662]: action_args: {'id': '29366fd0-eee1-4eb2-921a-c46b9677cc93'} Apr 14 03:09:37 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:09:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Returning 404 to user: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:09:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a7be5c68-d9eb-43ee-a33d-0c32dac3840e tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93" status: 404 len: 111 microversion: 2.42 time: 0.029722 Apr 14 03:09:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 186/563] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:09:37 2023] DELETE /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:09:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:37 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] [instance: 29366fd0-eee1-4eb2-921a-c46b9677cc93] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] HTTP exception thrown: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Request method failure captured: Apr 14 03:09:37 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 HTTP/1.1 Apr 14 03:09:37 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:09:37 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:09:37 user devstack@n-api.service[61663]: Connection: close Apr 14 03:09:37 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:09:37 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:09:37 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:09:37 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:09:37 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMMvnsqNsgssKRP_X77XYCUhGiF3IXpVd-WRqG-TNZdIwQBO0H2ctAVHRgEVJcSGzj-6NBxC822Dm-AQRmDp2TcJIqMNVgcIETuNZ_e6LpbmPkoOS0q4qssh60WI_09Vtnq-NgVZ4QpMN2zlG9u4fHTFUuwWVVULvhQMmR2XHnc6Nhw Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Project-Id: f1d531e7f7004ebaa529cb60de3849e7 Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-641324897 Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1d531e7f7004ebaa529cb60de3849e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1d531e7f7004ebaa529cb60de3849e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1d531e7f7004ebaa529cb60de3849e7"}]}] Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Tenant: tempest-TaggedBootDevicesTest_v242-641324897 Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Tenant-Id: f1d531e7f7004ebaa529cb60de3849e7 Apr 14 03:09:37 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-641324897 Apr 14 03:09:37 user devstack@n-api.service[61663]: X-User: tempest-TaggedBootDevicesTest_v242-641324897-project-member Apr 14 03:09:37 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:09:37 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:09:37 user devstack@n-api.service[61663]: X-User-Id: 5a311491e2924c49b01fd42458ec2fc2 Apr 14 03:09:37 user devstack@n-api.service[61663]: X-User-Name: tempest-TaggedBootDevicesTest_v242-641324897-project-member Apr 14 03:09:37 user devstack@n-api.service[61663]: method: > Apr 14 03:09:37 user devstack@n-api.service[61663]: exception: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:37 user devstack@n-api.service[61663]: action_args: {'id': '29366fd0-eee1-4eb2-921a-c46b9677cc93'} Apr 14 03:09:37 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. Apr 14 03:09:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:09:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] Returning 404 to user: Instance 29366fd0-eee1-4eb2-921a-c46b9677cc93 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:09:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7545c7ea-07a7-4864-8ab6-a7e7468e9069 tempest-TaggedBootDevicesTest_v242-641324897 tempest-TaggedBootDevicesTest_v242-641324897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93" status: 404 len: 111 microversion: 2.42 time: 0.034611 Apr 14 03:09:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 190/564] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:09:37 2023] GET /compute/v2.1/servers/29366fd0-eee1-4eb2-921a-c46b9677cc93 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:09:48 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-93b2d27c-dbba-4c62-8765-9d6752800c9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "673d2a71-c448-4ba0-ab84-2f243d2c7cf3"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:09:48 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-93b2d27c-dbba-4c62-8765-9d6752800c9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-93b2d27c-dbba-4c62-8765-9d6752800c9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-93b2d27c-dbba-4c62-8765-9d6752800c9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-93b2d27c-dbba-4c62-8765-9d6752800c9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-93b2d27c-dbba-4c62-8765-9d6752800c9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-93b2d27c-dbba-4c62-8765-9d6752800c9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-93b2d27c-dbba-4c62-8765-9d6752800c9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:48 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-93b2d27c-dbba-4c62-8765-9d6752800c9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lazy-loading 'flavor' on Instance uuid 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:09:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-93b2d27c-dbba-4c62-8765-9d6752800c9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a/action" status: 200 len: 29 microversion: 2.87 time: 0.572821 Apr 14 03:09:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 189/565] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 03:09:48 2023] POST /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a/action => generated 29 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=8 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:09:49 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:09:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-26ce46bf-eb48-42e2-af0a-9d70debaf604 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a" status: 200 len: 1776 microversion: 2.87 time: 0.368222 Apr 14 03:09:49 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 187/566] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:09:49 2023] GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a => generated 1776 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:09:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-9f0c0553-8afb-4cc0-a787-4afdfbc0c15c req-9251e2b5-bf57-4336-a35a-213a7bbf779e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:09:50 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:50 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9f0c0553-8afb-4cc0-a787-4afdfbc0c15c req-9251e2b5-bf57-4336-a35a-213a7bbf779e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9f0c0553-8afb-4cc0-a787-4afdfbc0c15c req-9251e2b5-bf57-4336-a35a-213a7bbf779e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9f0c0553-8afb-4cc0-a787-4afdfbc0c15c req-9251e2b5-bf57-4336-a35a-213a7bbf779e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-9f0c0553-8afb-4cc0-a787-4afdfbc0c15c req-9251e2b5-bf57-4336-a35a-213a7bbf779e service nova] Creating event network-vif-unplugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:09:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-9f0c0553-8afb-4cc0-a787-4afdfbc0c15c req-9251e2b5-bf57-4336-a35a-213a7bbf779e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052083 Apr 14 03:09:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 191/567] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:09:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:09:52 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-c2ddc2eb-6425-49da-a4f2-62dbbe372880 req-bb386ad7-10d1-4a48-9fb6-bff159be61f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:09:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c2ddc2eb-6425-49da-a4f2-62dbbe372880 req-bb386ad7-10d1-4a48-9fb6-bff159be61f4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c2ddc2eb-6425-49da-a4f2-62dbbe372880 req-bb386ad7-10d1-4a48-9fb6-bff159be61f4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c2ddc2eb-6425-49da-a4f2-62dbbe372880 req-bb386ad7-10d1-4a48-9fb6-bff159be61f4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c2ddc2eb-6425-49da-a4f2-62dbbe372880 req-bb386ad7-10d1-4a48-9fb6-bff159be61f4 service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:09:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-c2ddc2eb-6425-49da-a4f2-62dbbe372880 req-bb386ad7-10d1-4a48-9fb6-bff159be61f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060600 Apr 14 03:09:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 190/568] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:09:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:09:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-9855bfe2-d30f-4a86-9e9a-75e5a7b0fbde req-3797d432-8ff2-4be7-a604-715fd32f23e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:09:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9855bfe2-d30f-4a86-9e9a-75e5a7b0fbde req-3797d432-8ff2-4be7-a604-715fd32f23e0 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9855bfe2-d30f-4a86-9e9a-75e5a7b0fbde req-3797d432-8ff2-4be7-a604-715fd32f23e0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9855bfe2-d30f-4a86-9e9a-75e5a7b0fbde req-3797d432-8ff2-4be7-a604-715fd32f23e0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-9855bfe2-d30f-4a86-9e9a-75e5a7b0fbde req-3797d432-8ff2-4be7-a604-715fd32f23e0 service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:09:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-9855bfe2-d30f-4a86-9e9a-75e5a7b0fbde req-3797d432-8ff2-4be7-a604-715fd32f23e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038159 Apr 14 03:09:55 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 188/569] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:09:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:09:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3e43c313-74b1-4002-a230-8e3d0deced24 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:56 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3e43c313-74b1-4002-a230-8e3d0deced24 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7a1e2563-0dc3-4cc9-aa61-7cb321f28622] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e43c313-74b1-4002-a230-8e3d0deced24 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e43c313-74b1-4002-a230-8e3d0deced24 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e43c313-74b1-4002-a230-8e3d0deced24 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e43c313-74b1-4002-a230-8e3d0deced24 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e43c313-74b1-4002-a230-8e3d0deced24 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e43c313-74b1-4002-a230-8e3d0deced24 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:56 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-3e43c313-74b1-4002-a230-8e3d0deced24 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:09:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3e43c313-74b1-4002-a230-8e3d0deced24 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622" status: 200 len: 1443 microversion: 2.1 time: 0.535056 Apr 14 03:09:56 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 192/570] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:09:55 2023] GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 => generated 1443 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:09:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-2d70236e-3974-43d2-bd72-077faab4b635 req-29a10b12-369e-4c0f-ab36-df38db759709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:09:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2d70236e-3974-43d2-bd72-077faab4b635 req-29a10b12-369e-4c0f-ab36-df38db759709 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2d70236e-3974-43d2-bd72-077faab4b635 req-29a10b12-369e-4c0f-ab36-df38db759709 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2d70236e-3974-43d2-bd72-077faab4b635 req-29a10b12-369e-4c0f-ab36-df38db759709 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-2d70236e-3974-43d2-bd72-077faab4b635 req-29a10b12-369e-4c0f-ab36-df38db759709 service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:09:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-2d70236e-3974-43d2-bd72-077faab4b635 req-29a10b12-369e-4c0f-ab36-df38db759709 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067945 Apr 14 03:09:57 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 191/571] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:09:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:09:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-94888dc0-d782-440c-9087-d21054e29ac5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:58 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-94888dc0-d782-440c-9087-d21054e29ac5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7a1e2563-0dc3-4cc9-aa61-7cb321f28622] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94888dc0-d782-440c-9087-d21054e29ac5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94888dc0-d782-440c-9087-d21054e29ac5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94888dc0-d782-440c-9087-d21054e29ac5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94888dc0-d782-440c-9087-d21054e29ac5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94888dc0-d782-440c-9087-d21054e29ac5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-94888dc0-d782-440c-9087-d21054e29ac5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:59 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-94888dc0-d782-440c-9087-d21054e29ac5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7a1e2563-0dc3-4cc9-aa61-7cb321f28622] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:09:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-94888dc0-d782-440c-9087-d21054e29ac5 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622" status: 204 len: 0 microversion: 2.1 time: 0.145231 Apr 14 03:09:59 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 189/572] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:09:58 2023] DELETE /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:09:59 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-03bcfa0a-90d6-491d-8815-b29c2748a031 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:09:59 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-03bcfa0a-90d6-491d-8815-b29c2748a031 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7a1e2563-0dc3-4cc9-aa61-7cb321f28622] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:09:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03bcfa0a-90d6-491d-8815-b29c2748a031 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03bcfa0a-90d6-491d-8815-b29c2748a031 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03bcfa0a-90d6-491d-8815-b29c2748a031 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03bcfa0a-90d6-491d-8815-b29c2748a031 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03bcfa0a-90d6-491d-8815-b29c2748a031 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03bcfa0a-90d6-491d-8815-b29c2748a031 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-ecd706f5-2ca4-4f71-962b-2c1539506410 req-32dc0373-bc36-4947-bcfc-af78ca398ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a1e2563-0dc3-4cc9-aa61-7cb321f28622", "tag": "3ca37a66-26b1-4ab0-99fa-96237e59345f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:09:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ecd706f5-2ca4-4f71-962b-2c1539506410 req-32dc0373-bc36-4947-bcfc-af78ca398ed7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ecd706f5-2ca4-4f71-962b-2c1539506410 req-32dc0373-bc36-4947-bcfc-af78ca398ed7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ecd706f5-2ca4-4f71-962b-2c1539506410 req-32dc0373-bc36-4947-bcfc-af78ca398ed7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-ecd706f5-2ca4-4f71-962b-2c1539506410 req-32dc0373-bc36-4947-bcfc-af78ca398ed7 service nova] Creating event network-changed:3ca37a66-26b1-4ab0-99fa-96237e59345f for instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 on user Apr 14 03:09:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-ecd706f5-2ca4-4f71-962b-2c1539506410 req-32dc0373-bc36-4947-bcfc-af78ca398ed7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055753 Apr 14 03:09:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 192/573] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:09:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:09:59 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-7b8151e6-8c89-4aa3-a782-1bfe7dbaea63 req-ebd7b35a-96a6-4c05-b22a-b5aa16a1929f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1e2563-0dc3-4cc9-aa61-7cb321f28622", "name": "network-vif-unplugged", "status": "completed", "tag": "3ca37a66-26b1-4ab0-99fa-96237e59345f"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:09:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-7b8151e6-8c89-4aa3-a782-1bfe7dbaea63 req-ebd7b35a-96a6-4c05-b22a-b5aa16a1929f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:09:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-7b8151e6-8c89-4aa3-a782-1bfe7dbaea63 req-ebd7b35a-96a6-4c05-b22a-b5aa16a1929f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:09:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-7b8151e6-8c89-4aa3-a782-1bfe7dbaea63 req-ebd7b35a-96a6-4c05-b22a-b5aa16a1929f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:09:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-7b8151e6-8c89-4aa3-a782-1bfe7dbaea63 req-ebd7b35a-96a6-4c05-b22a-b5aa16a1929f service nova] Creating event network-vif-unplugged:3ca37a66-26b1-4ab0-99fa-96237e59345f for instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 on user Apr 14 03:09:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-7b8151e6-8c89-4aa3-a782-1bfe7dbaea63 req-ebd7b35a-96a6-4c05-b22a-b5aa16a1929f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036875 Apr 14 03:09:59 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 190/574] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:09:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:09:59 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-03bcfa0a-90d6-491d-8815-b29c2748a031 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:09:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-03bcfa0a-90d6-491d-8815-b29c2748a031 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622" status: 200 len: 1449 microversion: 2.1 time: 0.507418 Apr 14 03:09:59 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 193/575] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:09:59 2023] GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 => generated 1449 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:10:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-84c8e245-7501-429e-ab40-8f5fa9f49091 req-6b24e2b7-6e93-44a8-8034-9887d6510bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1e2563-0dc3-4cc9-aa61-7cb321f28622", "name": "network-vif-plugged", "status": "completed", "tag": "3ca37a66-26b1-4ab0-99fa-96237e59345f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-84c8e245-7501-429e-ab40-8f5fa9f49091 req-6b24e2b7-6e93-44a8-8034-9887d6510bdc service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-84c8e245-7501-429e-ab40-8f5fa9f49091 req-6b24e2b7-6e93-44a8-8034-9887d6510bdc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-84c8e245-7501-429e-ab40-8f5fa9f49091 req-6b24e2b7-6e93-44a8-8034-9887d6510bdc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-84c8e245-7501-429e-ab40-8f5fa9f49091 req-6b24e2b7-6e93-44a8-8034-9887d6510bdc service nova] Creating event network-vif-plugged:3ca37a66-26b1-4ab0-99fa-96237e59345f for instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 on user Apr 14 03:10:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-84c8e245-7501-429e-ab40-8f5fa9f49091 req-6b24e2b7-6e93-44a8-8034-9887d6510bdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034803 Apr 14 03:10:01 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 193/576] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:10:01 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-461cf38d-58bc-4727-baf6-699b84856eb8 req-0919f736-9c1e-4821-ae3d-591c0e0a8dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1e2563-0dc3-4cc9-aa61-7cb321f28622", "name": "network-vif-deleted", "tag": "3ca37a66-26b1-4ab0-99fa-96237e59345f"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-461cf38d-58bc-4727-baf6-699b84856eb8 req-0919f736-9c1e-4821-ae3d-591c0e0a8dfa service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-461cf38d-58bc-4727-baf6-699b84856eb8 req-0919f736-9c1e-4821-ae3d-591c0e0a8dfa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-461cf38d-58bc-4727-baf6-699b84856eb8 req-0919f736-9c1e-4821-ae3d-591c0e0a8dfa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-461cf38d-58bc-4727-baf6-699b84856eb8 req-0919f736-9c1e-4821-ae3d-591c0e0a8dfa service nova] Creating event network-vif-deleted:3ca37a66-26b1-4ab0-99fa-96237e59345f for instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 on user Apr 14 03:10:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-461cf38d-58bc-4727-baf6-699b84856eb8 req-0919f736-9c1e-4821-ae3d-591c0e0a8dfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033064 Apr 14 03:10:01 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 191/577] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4f1645fd-a33f-4c53-9e37-9665ebd8a727 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Action: 'create', calling method: .version_select at 0x7ff11a2edf30>, body: {"keypair": {"name": "tempest-keypair-1447416444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7w1V2h51K5WeC0lNrY7+q4q2XqyPZ1TB9opotq+DNhc9r2qQzgCUPc3xsU2/ON8yD/igMXO0IAbOHg83C68rdtapd1/KHmCO4Nj4cZtEPuSMjanMb8ZhuWuQX+Z2NrHw=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:04 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-4f1645fd-a33f-4c53-9e37-9665ebd8a727 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Getting quotas for project 82eb4fbf55f04294a3d97800142bdca9. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:10:04 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-4f1645fd-a33f-4c53-9e37-9665ebd8a727 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Getting quotas for user 3c683fe5636b49858857033797ff8e68 and project 82eb4fbf55f04294a3d97800142bdca9. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:10:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4f1645fd-a33f-4c53-9e37-9665ebd8a727 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.211189 Apr 14 03:10:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 194/578] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:10:04 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-196777223", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "ccf9becc-b97a-4847-b44d-cf9b5b02306c"}], "security_groups": [{"name": "tempest-securitygroup--1744918081"}], "key_name": "tempest-keypair-1447416444", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] validate_networks() for [('ccf9becc-b97a-4847-b44d-cf9b5b02306c', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Getting quotas for project 82eb4fbf55f04294a3d97800142bdca9. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Getting quotas for user 3c683fe5636b49858857033797ff8e68 and project 82eb4fbf55f04294a3d97800142bdca9. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:10:06 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:10:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ba3dd626-9044-467c-aefa-25d1f6f5fb02 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.605354 Apr 14 03:10:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 194/579] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:10:05 2023] POST /compute/v2.1/servers => generated 404 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:10:06 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f34e27d8-d55b-4d93-9734-6fb100538884 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:06 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-f34e27d8-d55b-4d93-9734-6fb100538884 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:06 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-f34e27d8-d55b-4d93-9734-6fb100538884 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c683fe5636b49858857033797ff8e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb4fbf55f04294a3d97800142bdca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:06 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f34e27d8-d55b-4d93-9734-6fb100538884 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3" status: 200 len: 1239 microversion: 2.1 time: 0.086443 Apr 14 03:10:06 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 192/580] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:10:06 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3 => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 03:10:08 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-171ddb1a-0b7b-47c0-bf7a-43b8b815c3ab tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:08 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-171ddb1a-0b7b-47c0-bf7a-43b8b815c3ab tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-171ddb1a-0b7b-47c0-bf7a-43b8b815c3ab tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-171ddb1a-0b7b-47c0-bf7a-43b8b815c3ab tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-171ddb1a-0b7b-47c0-bf7a-43b8b815c3ab tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-171ddb1a-0b7b-47c0-bf7a-43b8b815c3ab tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-171ddb1a-0b7b-47c0-bf7a-43b8b815c3ab tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-171ddb1a-0b7b-47c0-bf7a-43b8b815c3ab tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-171ddb1a-0b7b-47c0-bf7a-43b8b815c3ab tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.123774 Apr 14 03:10:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 195/581] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:10:08 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-interface => generated 282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f478156a-c95e-4c59-bcc8-e8e8544c9cf6 req-0fef86e4-4c29-4542-a989-80090e18a6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4bbe1e-d297-40e2-95d5-d8ab381c302d", "tag": "cf6c0efd-f0d7-4a17-837f-eefb2b1a5731"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f478156a-c95e-4c59-bcc8-e8e8544c9cf6 req-0fef86e4-4c29-4542-a989-80090e18a6ad service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f478156a-c95e-4c59-bcc8-e8e8544c9cf6 req-0fef86e4-4c29-4542-a989-80090e18a6ad service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f478156a-c95e-4c59-bcc8-e8e8544c9cf6 req-0fef86e4-4c29-4542-a989-80090e18a6ad service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f478156a-c95e-4c59-bcc8-e8e8544c9cf6 req-0fef86e4-4c29-4542-a989-80090e18a6ad service nova] Creating event network-changed:cf6c0efd-f0d7-4a17-837f-eefb2b1a5731 for instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d on user Apr 14 03:10:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f478156a-c95e-4c59-bcc8-e8e8544c9cf6 req-0fef86e4-4c29-4542-a989-80090e18a6ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038040 Apr 14 03:10:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 195/582] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:09 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-7cfddb31-f970-4ab5-bc57-c976273321ae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:09 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-7cfddb31-f970-4ab5-bc57-c976273321ae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7cfddb31-f970-4ab5-bc57-c976273321ae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7cfddb31-f970-4ab5-bc57-c976273321ae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7cfddb31-f970-4ab5-bc57-c976273321ae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7cfddb31-f970-4ab5-bc57-c976273321ae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7cfddb31-f970-4ab5-bc57-c976273321ae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7cfddb31-f970-4ab5-bc57-c976273321ae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:09 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-7cfddb31-f970-4ab5-bc57-c976273321ae tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/ips" status: 200 len: 103 microversion: 2.1 time: 0.039587 Apr 14 03:10:09 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 193/583] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 03:10:09 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/ips => generated 103 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:10:10 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-0d1b52b4-184b-4dd5-99f8-244f955d1cf6 req-037914c0-7d68-4898-b2cc-e85e6d8ea61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0d1b52b4-184b-4dd5-99f8-244f955d1cf6 req-037914c0-7d68-4898-b2cc-e85e6d8ea61f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0d1b52b4-184b-4dd5-99f8-244f955d1cf6 req-037914c0-7d68-4898-b2cc-e85e6d8ea61f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0d1b52b4-184b-4dd5-99f8-244f955d1cf6 req-037914c0-7d68-4898-b2cc-e85e6d8ea61f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-0d1b52b4-184b-4dd5-99f8-244f955d1cf6 req-037914c0-7d68-4898-b2cc-e85e6d8ea61f service nova] Creating event network-changed:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:10:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-0d1b52b4-184b-4dd5-99f8-244f955d1cf6 req-037914c0-7d68-4898-b2cc-e85e6d8ea61f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039746 Apr 14 03:10:10 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 196/584] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b7c0da23-79d5-45f0-9878-273d642d3aac tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d036730b-83f8-4181-bc64-2c80ee0e312f"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:12 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b7c0da23-79d5-45f0-9878-273d642d3aac tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b7c0da23-79d5-45f0-9878-273d642d3aac tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b7c0da23-79d5-45f0-9878-273d642d3aac tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b7c0da23-79d5-45f0-9878-273d642d3aac tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b7c0da23-79d5-45f0-9878-273d642d3aac tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b7c0da23-79d5-45f0-9878-273d642d3aac tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b7c0da23-79d5-45f0-9878-273d642d3aac tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b7c0da23-79d5-45f0-9878-273d642d3aac tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319126 Apr 14 03:10:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 196/585] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:10:12 2023] POST /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:12 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-550bbf57-4468-4873-aa8a-1273a2b68d3b req-b5bfe544-1a17-435f-8296-b12d0d0c503c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-550bbf57-4468-4873-aa8a-1273a2b68d3b req-b5bfe544-1a17-435f-8296-b12d0d0c503c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-550bbf57-4468-4873-aa8a-1273a2b68d3b req-b5bfe544-1a17-435f-8296-b12d0d0c503c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-550bbf57-4468-4873-aa8a-1273a2b68d3b req-b5bfe544-1a17-435f-8296-b12d0d0c503c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-550bbf57-4468-4873-aa8a-1273a2b68d3b req-b5bfe544-1a17-435f-8296-b12d0d0c503c service nova] Creating event network-vif-plugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:10:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-550bbf57-4468-4873-aa8a-1273a2b68d3b req-b5bfe544-1a17-435f-8296-b12d0d0c503c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079727 Apr 14 03:10:12 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 194/586] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:14 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ba68b2ed-063a-46b6-9f13-8f57ca8f0a11 req-9265bdad-940d-4c97-922c-2de52d618ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ba68b2ed-063a-46b6-9f13-8f57ca8f0a11 req-9265bdad-940d-4c97-922c-2de52d618ad0 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ba68b2ed-063a-46b6-9f13-8f57ca8f0a11 req-9265bdad-940d-4c97-922c-2de52d618ad0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ba68b2ed-063a-46b6-9f13-8f57ca8f0a11 req-9265bdad-940d-4c97-922c-2de52d618ad0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ba68b2ed-063a-46b6-9f13-8f57ca8f0a11 req-9265bdad-940d-4c97-922c-2de52d618ad0 service nova] Creating event network-vif-plugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:10:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ba68b2ed-063a-46b6-9f13-8f57ca8f0a11 req-9265bdad-940d-4c97-922c-2de52d618ad0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042260 Apr 14 03:10:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 197/587] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9dd36333-ea8d-4201-9359-feeada9c4a70 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2998d0d-9ff4-4d46-a62f-30f7df32be1f", "device": "/dev/vdb"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9dd36333-ea8d-4201-9359-feeada9c4a70 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: e1493ecb-e6a8-48c5-abf3-d3cbc092736a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9dd36333-ea8d-4201-9359-feeada9c4a70 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9dd36333-ea8d-4201-9359-feeada9c4a70 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9dd36333-ea8d-4201-9359-feeada9c4a70 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9dd36333-ea8d-4201-9359-feeada9c4a70 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9dd36333-ea8d-4201-9359-feeada9c4a70 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9dd36333-ea8d-4201-9359-feeada9c4a70 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:18 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9dd36333-ea8d-4201-9359-feeada9c4a70 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364653 Apr 14 03:10:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 197/588] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:10:18 2023] POST /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-1c51fb8c-c019-406b-bf46-c0ef34d7d2e3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-1c51fb8c-c019-406b-bf46-c0ef34d7d2e3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1c51fb8c-c019-406b-bf46-c0ef34d7d2e3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1c51fb8c-c019-406b-bf46-c0ef34d7d2e3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1c51fb8c-c019-406b-bf46-c0ef34d7d2e3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1c51fb8c-c019-406b-bf46-c0ef34d7d2e3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1c51fb8c-c019-406b-bf46-c0ef34d7d2e3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1c51fb8c-c019-406b-bf46-c0ef34d7d2e3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:20 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:20 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-1c51fb8c-c019-406b-bf46-c0ef34d7d2e3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052277 Apr 14 03:10:20 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 195/589] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:10:20 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f642d71d-6bc8-48a4-acc6-a910db43ed86 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:20 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f642d71d-6bc8-48a4-acc6-a910db43ed86 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:20 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f642d71d-6bc8-48a4-acc6-a910db43ed86 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f642d71d-6bc8-48a4-acc6-a910db43ed86 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f642d71d-6bc8-48a4-acc6-a910db43ed86 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f642d71d-6bc8-48a4-acc6-a910db43ed86 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f642d71d-6bc8-48a4-acc6-a910db43ed86 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f642d71d-6bc8-48a4-acc6-a910db43ed86 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:20 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=23 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f642d71d-6bc8-48a4-acc6-a910db43ed86 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments/d036730b-83f8-4181-bc64-2c80ee0e312f" status: 200 len: 194 microversion: 2.1 time: 0.053139 Apr 14 03:10:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 198/590] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 03:10:20 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments/d036730b-83f8-4181-bc64-2c80ee0e312f => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:21 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 4e47adee-bd94-4655-9bbd-ed59c5478531 while it is in vm_state rescued Apr 14 03:10:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Request method failure captured: Apr 14 03:10:21 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments/05d362e8-1aaf-4bbb-8a9f-9f153920e00c HTTP/1.1 Apr 14 03:10:21 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:10:21 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:10:21 user devstack@n-api.service[61664]: Connection: close Apr 14 03:10:21 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:10:21 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:10:21 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:10:21 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:10:21 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEwmVtNRDetgWO5mTD1bEUocoJOj9YFGH40WwivXpN1Xs8gxlA0vVPe_uVHwCMswvqd9NviH5dTXLGC0t38Yu4iQwgvLzajFOxfBIuObMRSmhp1Wer7zSPZ6VE5STLyrn3LfTG0y7nuum9vJ4mym9BmUd-cBbpnhMSg3gviUoA8AKw Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Project-Id: 558bfd7e1d9049d396381de148b0c4a5 Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/558bfd7e1d9049d396381de148b0c4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/558bfd7e1d9049d396381de148b0c4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/558bfd7e1d9049d396381de148b0c4a5"}]}] Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Tenant-Id: 558bfd7e1d9049d396381de148b0c4a5 Apr 14 03:10:21 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:10:21 user devstack@n-api.service[61664]: X-User: tempest-ServerRescueNegativeTestJSON-773851452-project-member Apr 14 03:10:21 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:10:21 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:10:21 user devstack@n-api.service[61664]: X-User-Id: d5e8150f1502427fb3148f20354d212e Apr 14 03:10:21 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-773851452-project-member Apr 14 03:10:21 user devstack@n-api.service[61664]: method: > Apr 14 03:10:21 user devstack@n-api.service[61664]: exception: Cannot 'detach_volume' instance 4e47adee-bd94-4655-9bbd-ed59c5478531 while it is in vm_state rescued Apr 14 03:10:21 user devstack@n-api.service[61664]: action_args: {'server_id': '4e47adee-bd94-4655-9bbd-ed59c5478531', 'id': '05d362e8-1aaf-4bbb-8a9f-9f153920e00c'} Apr 14 03:10:21 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4e47adee-bd94-4655-9bbd-ed59c5478531 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4e47adee-bd94-4655-9bbd-ed59c5478531 while it is in vm_state rescued Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4e47adee-bd94-4655-9bbd-ed59c5478531 while it is in vm_state rescued Apr 14 03:10:21 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:10:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Returning 409 to user: Cannot 'detach_volume' instance 4e47adee-bd94-4655-9bbd-ed59c5478531 while it is in vm_state rescued {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:10:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5d510853-6345-42d0-8b37-b972c8fc66b1 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments/05d362e8-1aaf-4bbb-8a9f-9f153920e00c" status: 409 len: 152 microversion: 2.1 time: 0.101962 Apr 14 03:10:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 198/591] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:10:21 2023] DELETE /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments/05d362e8-1aaf-4bbb-8a9f-9f153920e00c => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 03:10:21 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d92e85f1-255b-47cb-90c5-790370a9eb00 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:21 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d92e85f1-255b-47cb-90c5-790370a9eb00 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d92e85f1-255b-47cb-90c5-790370a9eb00 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d92e85f1-255b-47cb-90c5-790370a9eb00 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d92e85f1-255b-47cb-90c5-790370a9eb00 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d92e85f1-255b-47cb-90c5-790370a9eb00 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d92e85f1-255b-47cb-90c5-790370a9eb00 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d92e85f1-255b-47cb-90c5-790370a9eb00 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d92e85f1-255b-47cb-90c5-790370a9eb00 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/action" status: 202 len: 0 microversion: 2.1 time: 0.086567 Apr 14 03:10:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 196/592] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:10:21 2023] POST /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:10:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b8567f92-6315-473b-9331-846e878eb790 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:21 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b8567f92-6315-473b-9331-846e878eb790 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b8567f92-6315-473b-9331-846e878eb790 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b8567f92-6315-473b-9331-846e878eb790 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b8567f92-6315-473b-9331-846e878eb790 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b8567f92-6315-473b-9331-846e878eb790 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b8567f92-6315-473b-9331-846e878eb790 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b8567f92-6315-473b-9331-846e878eb790 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:22 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-b8567f92-6315-473b-9331-846e878eb790 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b8567f92-6315-473b-9331-846e878eb790 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531" status: 200 len: 1710 microversion: 2.1 time: 0.354635 Apr 14 03:10:22 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 199/593] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:10:21 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531 => generated 1710 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:10:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e6e4103b-f262-4e35-837a-536605389aca req-7864e27c-ee1d-47d2-b67b-8146e10e8d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-unplugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e6e4103b-f262-4e35-837a-536605389aca req-7864e27c-ee1d-47d2-b67b-8146e10e8d49 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e6e4103b-f262-4e35-837a-536605389aca req-7864e27c-ee1d-47d2-b67b-8146e10e8d49 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e6e4103b-f262-4e35-837a-536605389aca req-7864e27c-ee1d-47d2-b67b-8146e10e8d49 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e6e4103b-f262-4e35-837a-536605389aca req-7864e27c-ee1d-47d2-b67b-8146e10e8d49 service nova] Creating event network-vif-unplugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:10:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e6e4103b-f262-4e35-837a-536605389aca req-7864e27c-ee1d-47d2-b67b-8146e10e8d49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062702 Apr 14 03:10:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 199/594] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:23 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c688884e-23bd-4dde-8a6a-3aae4f38d758 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ab737c6-db1d-4122-beea-9f6938803b8a"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:23 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c688884e-23bd-4dde-8a6a-3aae4f38d758 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c688884e-23bd-4dde-8a6a-3aae4f38d758 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c688884e-23bd-4dde-8a6a-3aae4f38d758 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c688884e-23bd-4dde-8a6a-3aae4f38d758 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c688884e-23bd-4dde-8a6a-3aae4f38d758 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c688884e-23bd-4dde-8a6a-3aae4f38d758 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c688884e-23bd-4dde-8a6a-3aae4f38d758 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:23 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c688884e-23bd-4dde-8a6a-3aae4f38d758 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352901 Apr 14 03:10:23 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 197/595] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:10:23 2023] POST /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-087e0de9-8044-4d29-a5ef-19a9506144e3 req-146c8dc7-1be0-4ae9-aed0-68b258aa2bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-plugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-087e0de9-8044-4d29-a5ef-19a9506144e3 req-146c8dc7-1be0-4ae9-aed0-68b258aa2bbe service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-087e0de9-8044-4d29-a5ef-19a9506144e3 req-146c8dc7-1be0-4ae9-aed0-68b258aa2bbe service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-087e0de9-8044-4d29-a5ef-19a9506144e3 req-146c8dc7-1be0-4ae9-aed0-68b258aa2bbe service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-087e0de9-8044-4d29-a5ef-19a9506144e3 req-146c8dc7-1be0-4ae9-aed0-68b258aa2bbe service nova] Creating event network-vif-plugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:10:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-087e0de9-8044-4d29-a5ef-19a9506144e3 req-146c8dc7-1be0-4ae9-aed0-68b258aa2bbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049554 Apr 14 03:10:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 200/596] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-604635131", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "5c0957e8-ebf2-4e1b-82f8-370034962c6d"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:25 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] validate_networks() for [('5c0957e8-ebf2-4e1b-82f8-370034962c6d', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Getting quotas for project 1318728a20064d49b9c1b2f89175a364. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Getting quotas for user b2facbf385e8402c86706cc28d4707af and project 1318728a20064d49b9c1b2f89175a364. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:10:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: 1840cf40-2228-4506-9a3f-0c9d29373533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:10:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2710d8dd-5d95-4d9b-b13e-0bb810f38291 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.663947 Apr 14 03:10:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 200/597] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:10:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:10:26 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-e59cf0bc-aa0a-481d-810b-87c3c9c0bc99 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:26 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-e59cf0bc-aa0a-481d-810b-87c3c9c0bc99 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: 1840cf40-2228-4506-9a3f-0c9d29373533] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:26 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-e59cf0bc-aa0a-481d-810b-87c3c9c0bc99 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2facbf385e8402c86706cc28d4707af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318728a20064d49b9c1b2f89175a364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-e59cf0bc-aa0a-481d-810b-87c3c9c0bc99 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533" status: 200 len: 1207 microversion: 2.1 time: 0.071326 Apr 14 03:10:26 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 198/598] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:10:26 2023] GET /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533 => generated 1207 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:10:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-37b646c3-b373-4a37-9513-2f7c05c5323a req-58e6e455-f0fd-45de-b80c-7420e78dab16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-plugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}, {"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-plugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-37b646c3-b373-4a37-9513-2f7c05c5323a req-58e6e455-f0fd-45de-b80c-7420e78dab16 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-37b646c3-b373-4a37-9513-2f7c05c5323a req-58e6e455-f0fd-45de-b80c-7420e78dab16 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-37b646c3-b373-4a37-9513-2f7c05c5323a req-58e6e455-f0fd-45de-b80c-7420e78dab16 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-37b646c3-b373-4a37-9513-2f7c05c5323a req-58e6e455-f0fd-45de-b80c-7420e78dab16 service nova] Creating event network-vif-plugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:10:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-37b646c3-b373-4a37-9513-2f7c05c5323a req-58e6e455-f0fd-45de-b80c-7420e78dab16 service nova] Creating event network-vif-plugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:10:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-37b646c3-b373-4a37-9513-2f7c05c5323a req-58e6e455-f0fd-45de-b80c-7420e78dab16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034006 Apr 14 03:10:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 201/599] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-4863620e-d38b-4bef-ab55-2166804784ec req-0bd96d18-a697-4bb7-ae7e-ed8249da3261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1840cf40-2228-4506-9a3f-0c9d29373533", "tag": "6c925a4c-0f5a-4711-92b2-7440a5170256"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4863620e-d38b-4bef-ab55-2166804784ec req-0bd96d18-a697-4bb7-ae7e-ed8249da3261 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4863620e-d38b-4bef-ab55-2166804784ec req-0bd96d18-a697-4bb7-ae7e-ed8249da3261 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4863620e-d38b-4bef-ab55-2166804784ec req-0bd96d18-a697-4bb7-ae7e-ed8249da3261 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-4863620e-d38b-4bef-ab55-2166804784ec req-0bd96d18-a697-4bb7-ae7e-ed8249da3261 service nova] Creating event network-changed:6c925a4c-0f5a-4711-92b2-7440a5170256 for instance 1840cf40-2228-4506-9a3f-0c9d29373533 on user Apr 14 03:10:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-4863620e-d38b-4bef-ab55-2166804784ec req-0bd96d18-a697-4bb7-ae7e-ed8249da3261 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032990 Apr 14 03:10:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 201/600] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-55e6bf1d-bf74-4374-8073-31f4e4093efe tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:29 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-55e6bf1d-bf74-4374-8073-31f4e4093efe tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-55e6bf1d-bf74-4374-8073-31f4e4093efe tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-55e6bf1d-bf74-4374-8073-31f4e4093efe tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-55e6bf1d-bf74-4374-8073-31f4e4093efe tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-55e6bf1d-bf74-4374-8073-31f4e4093efe tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-55e6bf1d-bf74-4374-8073-31f4e4093efe tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-55e6bf1d-bf74-4374-8073-31f4e4093efe tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:29 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-55e6bf1d-bf74-4374-8073-31f4e4093efe tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-55e6bf1d-bf74-4374-8073-31f4e4093efe tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1721 microversion: 2.1 time: 0.233295 Apr 14 03:10:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 199/601] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:10:29 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:10:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-47565d89-31fa-4903-ae92-667e510bfeaf tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:29 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-47565d89-31fa-4903-ae92-667e510bfeaf tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47565d89-31fa-4903-ae92-667e510bfeaf tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47565d89-31fa-4903-ae92-667e510bfeaf tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47565d89-31fa-4903-ae92-667e510bfeaf tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47565d89-31fa-4903-ae92-667e510bfeaf tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47565d89-31fa-4903-ae92-667e510bfeaf tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47565d89-31fa-4903-ae92-667e510bfeaf tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:29 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-47565d89-31fa-4903-ae92-667e510bfeaf tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-47565d89-31fa-4903-ae92-667e510bfeaf tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1721 microversion: 2.1 time: 0.215873 Apr 14 03:10:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 202/602] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:10:29 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:10:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-ba8a4b17-8cae-4ca1-9b8c-da6838606b59 req-2dcc9a49-e57b-4897-af4d-e619ad3280ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1840cf40-2228-4506-9a3f-0c9d29373533", "name": "network-vif-plugged", "status": "completed", "tag": "6c925a4c-0f5a-4711-92b2-7440a5170256"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ba8a4b17-8cae-4ca1-9b8c-da6838606b59 req-2dcc9a49-e57b-4897-af4d-e619ad3280ae service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ba8a4b17-8cae-4ca1-9b8c-da6838606b59 req-2dcc9a49-e57b-4897-af4d-e619ad3280ae service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ba8a4b17-8cae-4ca1-9b8c-da6838606b59 req-2dcc9a49-e57b-4897-af4d-e619ad3280ae service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-ba8a4b17-8cae-4ca1-9b8c-da6838606b59 req-2dcc9a49-e57b-4897-af4d-e619ad3280ae service nova] Creating event network-vif-plugged:6c925a4c-0f5a-4711-92b2-7440a5170256 for instance 1840cf40-2228-4506-9a3f-0c9d29373533 on user Apr 14 03:10:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-ba8a4b17-8cae-4ca1-9b8c-da6838606b59 req-2dcc9a49-e57b-4897-af4d-e619ad3280ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064001 Apr 14 03:10:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 202/603] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:32 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-ff0f3e5f-1749-4bb5-83cd-4d4b212f3976 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:32 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-ff0f3e5f-1749-4bb5-83cd-4d4b212f3976 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ff0f3e5f-1749-4bb5-83cd-4d4b212f3976 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ff0f3e5f-1749-4bb5-83cd-4d4b212f3976 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ff0f3e5f-1749-4bb5-83cd-4d4b212f3976 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ff0f3e5f-1749-4bb5-83cd-4d4b212f3976 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ff0f3e5f-1749-4bb5-83cd-4d4b212f3976 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ff0f3e5f-1749-4bb5-83cd-4d4b212f3976 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:32 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-ff0f3e5f-1749-4bb5-83cd-4d4b212f3976 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057603 Apr 14 03:10:32 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 200/604] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:10:32 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-dada1f50-bd86-4ec9-98a6-6021fcea0b16 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-dada1f50-bd86-4ec9-98a6-6021fcea0b16 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dada1f50-bd86-4ec9-98a6-6021fcea0b16 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dada1f50-bd86-4ec9-98a6-6021fcea0b16 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dada1f50-bd86-4ec9-98a6-6021fcea0b16 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dada1f50-bd86-4ec9-98a6-6021fcea0b16 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dada1f50-bd86-4ec9-98a6-6021fcea0b16 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dada1f50-bd86-4ec9-98a6-6021fcea0b16 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-dada1f50-bd86-4ec9-98a6-6021fcea0b16 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments/d036730b-83f8-4181-bc64-2c80ee0e312f" status: 200 len: 194 microversion: 2.1 time: 0.058735 Apr 14 03:10:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 203/605] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 03:10:32 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments/d036730b-83f8-4181-bc64-2c80ee0e312f => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:32 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:32 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lazy-loading 'services' on Instance uuid 9c4bbe1e-d297-40e2-95d5-d8ab381c302d {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:10:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments/d036730b-83f8-4181-bc64-2c80ee0e312f" status: 202 len: 0 microversion: 2.1 time: 0.334402 Apr 14 03:10:32 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 203/606] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:10:32 2023] DELETE /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments/d036730b-83f8-4181-bc64-2c80ee0e312f => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:10:33 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-a6e0df49-9e85-41df-b536-105bfe82d06d req-25897d14-3aca-4fe6-b85c-7030505235c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1840cf40-2228-4506-9a3f-0c9d29373533", "name": "network-vif-plugged", "status": "completed", "tag": "6c925a4c-0f5a-4711-92b2-7440a5170256"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a6e0df49-9e85-41df-b536-105bfe82d06d req-25897d14-3aca-4fe6-b85c-7030505235c9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a6e0df49-9e85-41df-b536-105bfe82d06d req-25897d14-3aca-4fe6-b85c-7030505235c9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a6e0df49-9e85-41df-b536-105bfe82d06d req-25897d14-3aca-4fe6-b85c-7030505235c9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-a6e0df49-9e85-41df-b536-105bfe82d06d req-25897d14-3aca-4fe6-b85c-7030505235c9 service nova] Creating event network-vif-plugged:6c925a4c-0f5a-4711-92b2-7440a5170256 for instance 1840cf40-2228-4506-9a3f-0c9d29373533 on user Apr 14 03:10:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-a6e0df49-9e85-41df-b536-105bfe82d06d req-25897d14-3aca-4fe6-b85c-7030505235c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043652 Apr 14 03:10:34 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 201/607] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c85135b6-797b-483d-96dd-66098d604074 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c85135b6-797b-483d-96dd-66098d604074 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c85135b6-797b-483d-96dd-66098d604074 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c85135b6-797b-483d-96dd-66098d604074 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c85135b6-797b-483d-96dd-66098d604074 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c85135b6-797b-483d-96dd-66098d604074 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c85135b6-797b-483d-96dd-66098d604074 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c85135b6-797b-483d-96dd-66098d604074 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c85135b6-797b-483d-96dd-66098d604074 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments/4ab737c6-db1d-4122-beea-9f6938803b8a" status: 200 len: 194 microversion: 2.1 time: 0.042702 Apr 14 03:10:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 204/608] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 03:10:36 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments/4ab737c6-db1d-4122-beea-9f6938803b8a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b45712cc-23c9-45f0-85d7-122bede1cee3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b45712cc-23c9-45f0-85d7-122bede1cee3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b45712cc-23c9-45f0-85d7-122bede1cee3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b45712cc-23c9-45f0-85d7-122bede1cee3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b45712cc-23c9-45f0-85d7-122bede1cee3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b45712cc-23c9-45f0-85d7-122bede1cee3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b45712cc-23c9-45f0-85d7-122bede1cee3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b45712cc-23c9-45f0-85d7-122bede1cee3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:36 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-b45712cc-23c9-45f0-85d7-122bede1cee3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lazy-loading 'services' on Instance uuid 9c4bbe1e-d297-40e2-95d5-d8ab381c302d {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:10:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b45712cc-23c9-45f0-85d7-122bede1cee3 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments/4ab737c6-db1d-4122-beea-9f6938803b8a" status: 202 len: 0 microversion: 2.1 time: 0.182335 Apr 14 03:10:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 204/609] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:10:36 2023] DELETE /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments/4ab737c6-db1d-4122-beea-9f6938803b8a => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:10:38 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:38 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-4b2305e1-074a-43ab-b18c-56607d84b772 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:38 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-4b2305e1-074a-43ab-b18c-56607d84b772 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4b2305e1-074a-43ab-b18c-56607d84b772 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4b2305e1-074a-43ab-b18c-56607d84b772 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4b2305e1-074a-43ab-b18c-56607d84b772 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4b2305e1-074a-43ab-b18c-56607d84b772 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4b2305e1-074a-43ab-b18c-56607d84b772 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4b2305e1-074a-43ab-b18c-56607d84b772 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-4b2305e1-074a-43ab-b18c-56607d84b772 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052939 Apr 14 03:10:38 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 202/610] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:10:38 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:10:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7af355d0-21d0-4e50-894c-1fb50d5ff9ba tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:38 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7af355d0-21d0-4e50-894c-1fb50d5ff9ba tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af355d0-21d0-4e50-894c-1fb50d5ff9ba tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af355d0-21d0-4e50-894c-1fb50d5ff9ba tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af355d0-21d0-4e50-894c-1fb50d5ff9ba tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af355d0-21d0-4e50-894c-1fb50d5ff9ba tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af355d0-21d0-4e50-894c-1fb50d5ff9ba tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af355d0-21d0-4e50-894c-1fb50d5ff9ba tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7af355d0-21d0-4e50-894c-1fb50d5ff9ba tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048670 Apr 14 03:10:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 205/611] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:10:38 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2799c90d-992a-4936-bf80-75ea6c7f30e0 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2799c90d-992a-4936-bf80-75ea6c7f30e0 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2799c90d-992a-4936-bf80-75ea6c7f30e0 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2799c90d-992a-4936-bf80-75ea6c7f30e0 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2799c90d-992a-4936-bf80-75ea6c7f30e0 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2799c90d-992a-4936-bf80-75ea6c7f30e0 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2799c90d-992a-4936-bf80-75ea6c7f30e0 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2799c90d-992a-4936-bf80-75ea6c7f30e0 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2799c90d-992a-4936-bf80-75ea6c7f30e0 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:10:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2799c90d-992a-4936-bf80-75ea6c7f30e0 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d" status: 204 len: 0 microversion: 2.1 time: 0.121606 Apr 14 03:10:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 205/612] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:10:39 2023] DELETE /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:10:39 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-eee2b964-038b-4ec4-ba18-256fb45e4921 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:39 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-eee2b964-038b-4ec4-ba18-256fb45e4921 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eee2b964-038b-4ec4-ba18-256fb45e4921 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eee2b964-038b-4ec4-ba18-256fb45e4921 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eee2b964-038b-4ec4-ba18-256fb45e4921 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eee2b964-038b-4ec4-ba18-256fb45e4921 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eee2b964-038b-4ec4-ba18-256fb45e4921 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eee2b964-038b-4ec4-ba18-256fb45e4921 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:39 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-eee2b964-038b-4ec4-ba18-256fb45e4921 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78d4991b5493e8893034e91ed407b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130665008cf648cf87467ae2777a9170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:39 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-eee2b964-038b-4ec4-ba18-256fb45e4921 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d" status: 200 len: 1660 microversion: 2.1 time: 0.211656 Apr 14 03:10:39 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 203/613] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:10:39 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d => generated 1660 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:10:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-16de160b-fe08-4954-ac55-04beba4a71cf req-c0bacfd6-4936-4ce3-8f68-8ac286522a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4bbe1e-d297-40e2-95d5-d8ab381c302d", "name": "network-vif-unplugged", "status": "completed", "tag": "cf6c0efd-f0d7-4a17-837f-eefb2b1a5731"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-16de160b-fe08-4954-ac55-04beba4a71cf req-c0bacfd6-4936-4ce3-8f68-8ac286522a99 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-16de160b-fe08-4954-ac55-04beba4a71cf req-c0bacfd6-4936-4ce3-8f68-8ac286522a99 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-16de160b-fe08-4954-ac55-04beba4a71cf req-c0bacfd6-4936-4ce3-8f68-8ac286522a99 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-16de160b-fe08-4954-ac55-04beba4a71cf req-c0bacfd6-4936-4ce3-8f68-8ac286522a99 service nova] Creating event network-vif-unplugged:cf6c0efd-f0d7-4a17-837f-eefb2b1a5731 for instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d on user Apr 14 03:10:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-16de160b-fe08-4954-ac55-04beba4a71cf req-c0bacfd6-4936-4ce3-8f68-8ac286522a99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030265 Apr 14 03:10:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 206/614] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:39 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b96cda6e-da7f-4f4a-8c66-dd6821a181d7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a" status: 200 len: 1756 microversion: 2.87 time: 0.399533 Apr 14 03:10:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 206/615] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:10:39 2023] GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a => generated 1756 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:10:40 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-b3c9b5d6-7de0-424b-82fa-4fd9595589c7 req-9697d9f4-ddc2-4f67-84dd-bba77bb62703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4bbe1e-d297-40e2-95d5-d8ab381c302d", "name": "network-vif-deleted", "tag": "cf6c0efd-f0d7-4a17-837f-eefb2b1a5731"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b3c9b5d6-7de0-424b-82fa-4fd9595589c7 req-9697d9f4-ddc2-4f67-84dd-bba77bb62703 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b3c9b5d6-7de0-424b-82fa-4fd9595589c7 req-9697d9f4-ddc2-4f67-84dd-bba77bb62703 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b3c9b5d6-7de0-424b-82fa-4fd9595589c7 req-9697d9f4-ddc2-4f67-84dd-bba77bb62703 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-b3c9b5d6-7de0-424b-82fa-4fd9595589c7 req-9697d9f4-ddc2-4f67-84dd-bba77bb62703 service nova] Creating event network-vif-deleted:cf6c0efd-f0d7-4a17-837f-eefb2b1a5731 for instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d on user Apr 14 03:10:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-b3c9b5d6-7de0-424b-82fa-4fd9595589c7 req-9697d9f4-ddc2-4f67-84dd-bba77bb62703 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041680 Apr 14 03:10:41 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 204/616] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-459a2f2f-b933-4184-b435-4f3180d7dcf9 req-875db15c-eae2-4f2c-b356-8309a431cb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4bbe1e-d297-40e2-95d5-d8ab381c302d", "name": "network-vif-plugged", "status": "completed", "tag": "cf6c0efd-f0d7-4a17-837f-eefb2b1a5731"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-459a2f2f-b933-4184-b435-4f3180d7dcf9 req-875db15c-eae2-4f2c-b356-8309a431cb76 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-459a2f2f-b933-4184-b435-4f3180d7dcf9 req-875db15c-eae2-4f2c-b356-8309a431cb76 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-459a2f2f-b933-4184-b435-4f3180d7dcf9 req-875db15c-eae2-4f2c-b356-8309a431cb76 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-459a2f2f-b933-4184-b435-4f3180d7dcf9 req-875db15c-eae2-4f2c-b356-8309a431cb76 service nova] Creating event network-vif-plugged:cf6c0efd-f0d7-4a17-837f-eefb2b1a5731 for instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d on user Apr 14 03:10:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-459a2f2f-b933-4184-b435-4f3180d7dcf9 req-875db15c-eae2-4f2c-b356-8309a431cb76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069985 Apr 14 03:10:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 207/617] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:46 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: e1493ecb-e6a8-48c5-abf3-d3cbc092736a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:46 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lazy-loading 'services' on Instance uuid e1493ecb-e6a8-48c5-abf3-d3cbc092736a {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:10:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a/os-volume_attachments/a2998d0d-9ff4-4d46-a62f-30f7df32be1f" status: 202 len: 0 microversion: 2.1 time: 0.162502 Apr 14 03:10:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 207/618] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:10:46 2023] DELETE /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a/os-volume_attachments/a2998d0d-9ff4-4d46-a62f-30f7df32be1f => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:10:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-6ba778d4-8092-4bb5-83c3-b233fbc50417 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:46 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-6ba778d4-8092-4bb5-83c3-b233fbc50417 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: e1493ecb-e6a8-48c5-abf3-d3cbc092736a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6ba778d4-8092-4bb5-83c3-b233fbc50417 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6ba778d4-8092-4bb5-83c3-b233fbc50417 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6ba778d4-8092-4bb5-83c3-b233fbc50417 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6ba778d4-8092-4bb5-83c3-b233fbc50417 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6ba778d4-8092-4bb5-83c3-b233fbc50417 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6ba778d4-8092-4bb5-83c3-b233fbc50417 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:46 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-6ba778d4-8092-4bb5-83c3-b233fbc50417 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: e1493ecb-e6a8-48c5-abf3-d3cbc092736a] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:10:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-6ba778d4-8092-4bb5-83c3-b233fbc50417 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a" status: 204 len: 0 microversion: 2.1 time: 0.111562 Apr 14 03:10:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 205/619] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:10:46 2023] DELETE /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:10:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1b590717-f3b6-4cc9-a149-d43dadcb662a tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:46 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1b590717-f3b6-4cc9-a149-d43dadcb662a tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: e1493ecb-e6a8-48c5-abf3-d3cbc092736a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1b590717-f3b6-4cc9-a149-d43dadcb662a tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1b590717-f3b6-4cc9-a149-d43dadcb662a tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1b590717-f3b6-4cc9-a149-d43dadcb662a tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1b590717-f3b6-4cc9-a149-d43dadcb662a tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1b590717-f3b6-4cc9-a149-d43dadcb662a tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1b590717-f3b6-4cc9-a149-d43dadcb662a tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:46 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-1b590717-f3b6-4cc9-a149-d43dadcb662a tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0128a733bd6a4120addba5eda1cc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4549f6080dcf4c739ac03ef643801fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1b590717-f3b6-4cc9-a149-d43dadcb662a tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a" status: 200 len: 1547 microversion: 2.1 time: 0.168445 Apr 14 03:10:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 208/620] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:10:46 2023] GET /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:10:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-3c4c3aba-5d8c-4cf8-83d9-feab4fad89e9 req-a0675d04-c612-430f-98e4-ffbebfa81fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1493ecb-e6a8-48c5-abf3-d3cbc092736a", "name": "network-vif-unplugged", "status": "completed", "tag": "136dada7-395e-410e-8eee-03e4d82dc01a"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3c4c3aba-5d8c-4cf8-83d9-feab4fad89e9 req-a0675d04-c612-430f-98e4-ffbebfa81fe9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3c4c3aba-5d8c-4cf8-83d9-feab4fad89e9 req-a0675d04-c612-430f-98e4-ffbebfa81fe9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3c4c3aba-5d8c-4cf8-83d9-feab4fad89e9 req-a0675d04-c612-430f-98e4-ffbebfa81fe9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-3c4c3aba-5d8c-4cf8-83d9-feab4fad89e9 req-a0675d04-c612-430f-98e4-ffbebfa81fe9 service nova] Creating event network-vif-unplugged:136dada7-395e-410e-8eee-03e4d82dc01a for instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a on user Apr 14 03:10:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-3c4c3aba-5d8c-4cf8-83d9-feab4fad89e9 req-a0675d04-c612-430f-98e4-ffbebfa81fe9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029561 Apr 14 03:10:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 208/621] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-8b507c25-beab-4386-89b5-e43a13ac090c req-b375ac20-2062-4bca-8963-02b3765eb5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1493ecb-e6a8-48c5-abf3-d3cbc092736a", "name": "network-vif-deleted", "tag": "136dada7-395e-410e-8eee-03e4d82dc01a"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8b507c25-beab-4386-89b5-e43a13ac090c req-b375ac20-2062-4bca-8963-02b3765eb5e2 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8b507c25-beab-4386-89b5-e43a13ac090c req-b375ac20-2062-4bca-8963-02b3765eb5e2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8b507c25-beab-4386-89b5-e43a13ac090c req-b375ac20-2062-4bca-8963-02b3765eb5e2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8b507c25-beab-4386-89b5-e43a13ac090c req-b375ac20-2062-4bca-8963-02b3765eb5e2 service nova] Creating event network-vif-deleted:136dada7-395e-410e-8eee-03e4d82dc01a for instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a on user Apr 14 03:10:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-8b507c25-beab-4386-89b5-e43a13ac090c req-b375ac20-2062-4bca-8963-02b3765eb5e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029056 Apr 14 03:10:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:49 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 206/622] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:49 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7a1e2563-0dc3-4cc9-aa61-7cb321f28622] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:10:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:10:49 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 HTTP/1.1 Apr 14 03:10:49 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:10:49 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:10:49 user devstack@n-api.service[61663]: Connection: close Apr 14 03:10:49 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:10:49 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:10:49 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:10:49 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:10:49 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:10:49 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:10:49 user devstack@n-api.service[61663]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:10:49 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:10:49 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:10:49 user devstack@n-api.service[61663]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:10:49 user devstack@n-api.service[61663]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:10:49 user devstack@n-api.service[61663]: method: > Apr 14 03:10:49 user devstack@n-api.service[61663]: exception: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:10:49 user devstack@n-api.service[61663]: action_args: {'id': '7a1e2563-0dc3-4cc9-aa61-7cb321f28622'} Apr 14 03:10:49 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:10:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:10:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:10:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-56d60da0-21a9-4137-9045-48d896a3ae97 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622" status: 404 len: 111 microversion: 2.1 time: 0.036912 Apr 14 03:10:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 209/623] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:10:49 2023] GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:10:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1780392212", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-742486677", "security_groups": [{"name": "tempest-secgroup-smoke-1898708055"}], "block_device_mapping_v2": [{"uuid": "c6fbfee2-70fa-477a-a761-8d092061e691", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ea0f3bca-5794-46e4-a270-53dbe99375bd"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:49 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:49 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] validate_networks() for [('ea0f3bca-5794-46e4-a270-53dbe99375bd', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for user 60e11b7ab2914209b23bf7a53791da64 and project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:10:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7f542934-641f-405f-811c-3601a3be389b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6fbfee2-70fa-477a-a761-8d092061e691',volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:10:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.733507 Apr 14 03:10:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 209/624] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:10:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:10:50 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-11d3c144-bfea-4b3d-81f5-f0fb05021aa6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:50 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-11d3c144-bfea-4b3d-81f5-f0fb05021aa6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7f542934-641f-405f-811c-3601a3be389b] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:50 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a1875c42-b5ad-4bdd-adae-dc64705d5bdd req-d186f96c-3989-4901-8303-4134f7f60f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1493ecb-e6a8-48c5-abf3-d3cbc092736a", "name": "network-vif-plugged", "status": "completed", "tag": "136dada7-395e-410e-8eee-03e4d82dc01a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:50 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=24 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a1875c42-b5ad-4bdd-adae-dc64705d5bdd req-d186f96c-3989-4901-8303-4134f7f60f0c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a1875c42-b5ad-4bdd-adae-dc64705d5bdd req-d186f96c-3989-4901-8303-4134f7f60f0c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a1875c42-b5ad-4bdd-adae-dc64705d5bdd req-d186f96c-3989-4901-8303-4134f7f60f0c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:50 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=52 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a1875c42-b5ad-4bdd-adae-dc64705d5bdd req-d186f96c-3989-4901-8303-4134f7f60f0c service nova] Creating event network-vif-plugged:136dada7-395e-410e-8eee-03e4d82dc01a for instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a on user Apr 14 03:10:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a1875c42-b5ad-4bdd-adae-dc64705d5bdd req-d186f96c-3989-4901-8303-4134f7f60f0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039182 Apr 14 03:10:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 210/625] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:51 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-11d3c144-bfea-4b3d-81f5-f0fb05021aa6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:51 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-11d3c144-bfea-4b3d-81f5-f0fb05021aa6 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b" status: 200 len: 1089 microversion: 2.1 time: 0.818000 Apr 14 03:10:51 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 207/626] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:10:50 2023] GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b => generated 1089 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:10:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-2e4d8779-3e56-44cf-b963-ac878bc76632 req-0bdd3c5a-84ac-4552-a951-c4d577b69b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f542934-641f-405f-811c-3601a3be389b", "tag": "1ccf0327-517f-45c5-a995-1b3a7fcfdaf9"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2e4d8779-3e56-44cf-b963-ac878bc76632 req-0bdd3c5a-84ac-4552-a951-c4d577b69b9d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2e4d8779-3e56-44cf-b963-ac878bc76632 req-0bdd3c5a-84ac-4552-a951-c4d577b69b9d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2e4d8779-3e56-44cf-b963-ac878bc76632 req-0bdd3c5a-84ac-4552-a951-c4d577b69b9d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-2e4d8779-3e56-44cf-b963-ac878bc76632 req-0bdd3c5a-84ac-4552-a951-c4d577b69b9d service nova] Creating event network-changed:1ccf0327-517f-45c5-a995-1b3a7fcfdaf9 for instance 7f542934-641f-405f-811c-3601a3be389b on user Apr 14 03:10:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-2e4d8779-3e56-44cf-b963-ac878bc76632 req-0bdd3c5a-84ac-4552-a951-c4d577b69b9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078970 Apr 14 03:10:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 210/627] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:10:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6e3c9dc6-cefc-4d7a-a2bb-f636f15d4050 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:10:56 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6e3c9dc6-cefc-4d7a-a2bb-f636f15d4050 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:10:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6e3c9dc6-cefc-4d7a-a2bb-f636f15d4050 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6e3c9dc6-cefc-4d7a-a2bb-f636f15d4050 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6e3c9dc6-cefc-4d7a-a2bb-f636f15d4050 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6e3c9dc6-cefc-4d7a-a2bb-f636f15d4050 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6e3c9dc6-cefc-4d7a-a2bb-f636f15d4050 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6e3c9dc6-cefc-4d7a-a2bb-f636f15d4050 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:56 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-6e3c9dc6-cefc-4d7a-a2bb-f636f15d4050 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c683fe5636b49858857033797ff8e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb4fbf55f04294a3d97800142bdca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:10:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6e3c9dc6-cefc-4d7a-a2bb-f636f15d4050 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3" status: 200 len: 1554 microversion: 2.1 time: 0.161017 Apr 14 03:10:56 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 211/628] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:10:56 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:10:59 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-d561bc62-3602-433a-aed5-7f1a8540e421 req-92b7c43b-9ce4-4173-921a-8f4ef03edd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f542934-641f-405f-811c-3601a3be389b", "name": "network-vif-plugged", "status": "completed", "tag": "1ccf0327-517f-45c5-a995-1b3a7fcfdaf9"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:10:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d561bc62-3602-433a-aed5-7f1a8540e421 req-92b7c43b-9ce4-4173-921a-8f4ef03edd18 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:10:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d561bc62-3602-433a-aed5-7f1a8540e421 req-92b7c43b-9ce4-4173-921a-8f4ef03edd18 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:10:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d561bc62-3602-433a-aed5-7f1a8540e421 req-92b7c43b-9ce4-4173-921a-8f4ef03edd18 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:10:59 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-d561bc62-3602-433a-aed5-7f1a8540e421 req-92b7c43b-9ce4-4173-921a-8f4ef03edd18 service nova] Creating event network-vif-plugged:1ccf0327-517f-45c5-a995-1b3a7fcfdaf9 for instance 7f542934-641f-405f-811c-3601a3be389b on user Apr 14 03:10:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-d561bc62-3602-433a-aed5-7f1a8540e421 req-92b7c43b-9ce4-4173-921a-8f4ef03edd18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041961 Apr 14 03:10:59 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 208/629] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:10:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:01 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:01 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-6091bb27-a9a2-472c-b599-4cc9fb48896d req-0302ccee-8ea2-4af3-a0e9-73cc9a3a0508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f542934-641f-405f-811c-3601a3be389b", "name": "network-vif-plugged", "status": "completed", "tag": "1ccf0327-517f-45c5-a995-1b3a7fcfdaf9"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6091bb27-a9a2-472c-b599-4cc9fb48896d req-0302ccee-8ea2-4af3-a0e9-73cc9a3a0508 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6091bb27-a9a2-472c-b599-4cc9fb48896d req-0302ccee-8ea2-4af3-a0e9-73cc9a3a0508 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6091bb27-a9a2-472c-b599-4cc9fb48896d req-0302ccee-8ea2-4af3-a0e9-73cc9a3a0508 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6091bb27-a9a2-472c-b599-4cc9fb48896d req-0302ccee-8ea2-4af3-a0e9-73cc9a3a0508 service nova] Creating event network-vif-plugged:1ccf0327-517f-45c5-a995-1b3a7fcfdaf9 for instance 7f542934-641f-405f-811c-3601a3be389b on user Apr 14 03:11:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-6091bb27-a9a2-472c-b599-4cc9fb48896d req-0302ccee-8ea2-4af3-a0e9-73cc9a3a0508 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053996 Apr 14 03:11:01 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 211/630] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bd584642-814d-4af6-8880-c8ac5a63e0ee tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-bd584642-814d-4af6-8880-c8ac5a63e0ee tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=7 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd584642-814d-4af6-8880-c8ac5a63e0ee tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd584642-814d-4af6-8880-c8ac5a63e0ee tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd584642-814d-4af6-8880-c8ac5a63e0ee tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd584642-814d-4af6-8880-c8ac5a63e0ee tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd584642-814d-4af6-8880-c8ac5a63e0ee tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd584642-814d-4af6-8880-c8ac5a63e0ee tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:12 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-bd584642-814d-4af6-8880-c8ac5a63e0ee tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:11:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-bd584642-814d-4af6-8880-c8ac5a63e0ee tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531" status: 200 len: 1716 microversion: 2.1 time: 0.248190 Apr 14 03:11:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 212/631] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:11:12 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531 => generated 1716 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=5 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-ee24c613-94db-40c0-a1e0-866be14ad76e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-ee24c613-94db-40c0-a1e0-866be14ad76e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: 1840cf40-2228-4506-9a3f-0c9d29373533] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ee24c613-94db-40c0-a1e0-866be14ad76e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ee24c613-94db-40c0-a1e0-866be14ad76e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ee24c613-94db-40c0-a1e0-866be14ad76e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ee24c613-94db-40c0-a1e0-866be14ad76e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ee24c613-94db-40c0-a1e0-866be14ad76e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ee24c613-94db-40c0-a1e0-866be14ad76e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:16 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-ee24c613-94db-40c0-a1e0-866be14ad76e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2facbf385e8402c86706cc28d4707af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318728a20064d49b9c1b2f89175a364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:11:16 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-ee24c613-94db-40c0-a1e0-866be14ad76e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533" status: 200 len: 1485 microversion: 2.1 time: 0.183711 Apr 14 03:11:16 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 209/632] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:11:16 2023] GET /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533 => generated 1485 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=5 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] HTTP exception thrown: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Request method failure captured: Apr 14 03:11:29 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d HTTP/1.1 Apr 14 03:11:29 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:11:29 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:11:29 user devstack@n-api.service[61664]: Connection: close Apr 14 03:11:29 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:11:29 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:11:29 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:11:29 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:11:29 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEniurR-XYJH0ZsYBHACYc2Zz3VSVL6yUXC8j91UZj78M-vPYDpcO60-6eaqaHLWYpPbpccNUvjFp9pyS_m4sBAblTzSWOml6ZCQK1pdCAcsetJPcy0uVsyqGF5p5SZT3i5ItzPWKpdfOldEDH_gufTZE_3MMAqDqtKJlFrrg7DPAU Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Project-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/130665008cf648cf87467ae2777a9170"}]}] Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Tenant-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:11:29 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:29 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:11:29 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:11:29 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:11:29 user devstack@n-api.service[61664]: X-User-Id: d6d78d4991b5493e8893034e91ed407b Apr 14 03:11:29 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:11:29 user devstack@n-api.service[61664]: method: > Apr 14 03:11:29 user devstack@n-api.service[61664]: exception: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:29 user devstack@n-api.service[61664]: action_args: {'id': '9c4bbe1e-d297-40e2-95d5-d8ab381c302d'} Apr 14 03:11:29 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Returning 404 to user: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:11:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-38c249d3-c2f5-4d71-801e-2e2b5e44d0c6 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d" status: 404 len: 111 microversion: 2.1 time: 0.079379 Apr 14 03:11:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 212/633] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:11:29 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:11:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-62d8c1cb-e6f1-432d-9162-684d95b0efdf tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '.version_select at 0x7ff11a4e1ab0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:29 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:29 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-62d8c1cb-e6f1-432d-9162-684d95b0efdf tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327512481" status: 202 len: 0 microversion: 2.1 time: 0.028374 Apr 14 03:11:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 213/634] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 03:11:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327512481 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-5fac981a-162e-453b-87d0-6cfc008f053d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-5fac981a-162e-453b-87d0-6cfc008f053d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5fac981a-162e-453b-87d0-6cfc008f053d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5fac981a-162e-453b-87d0-6cfc008f053d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5fac981a-162e-453b-87d0-6cfc008f053d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5fac981a-162e-453b-87d0-6cfc008f053d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5fac981a-162e-453b-87d0-6cfc008f053d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5fac981a-162e-453b-87d0-6cfc008f053d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:30 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-5fac981a-162e-453b-87d0-6cfc008f053d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:11:30 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-5fac981a-162e-453b-87d0-6cfc008f053d tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 204 len: 0 microversion: 2.1 time: 0.244399 Apr 14 03:11:30 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 210/635] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:11:29 2023] DELETE /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:11:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2c2f9693-be99-463f-9af2-6bee7497e6ef tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:30 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2c2f9693-be99-463f-9af2-6bee7497e6ef tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c2f9693-be99-463f-9af2-6bee7497e6ef tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c2f9693-be99-463f-9af2-6bee7497e6ef tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c2f9693-be99-463f-9af2-6bee7497e6ef tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c2f9693-be99-463f-9af2-6bee7497e6ef tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c2f9693-be99-463f-9af2-6bee7497e6ef tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c2f9693-be99-463f-9af2-6bee7497e6ef tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:30 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-2c2f9693-be99-463f-9af2-6bee7497e6ef tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:11:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2c2f9693-be99-463f-9af2-6bee7497e6ef tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 200 len: 1727 microversion: 2.1 time: 0.354934 Apr 14 03:11:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 213/636] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:11:30 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 1727 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:11:30 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-442d61e8-4d77-4929-a0ad-e8cd2c965ac7 req-82762498-6f33-4089-9651-9b26399f7fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-unplugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-442d61e8-4d77-4929-a0ad-e8cd2c965ac7 req-82762498-6f33-4089-9651-9b26399f7fb8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-442d61e8-4d77-4929-a0ad-e8cd2c965ac7 req-82762498-6f33-4089-9651-9b26399f7fb8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-442d61e8-4d77-4929-a0ad-e8cd2c965ac7 req-82762498-6f33-4089-9651-9b26399f7fb8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:30 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-442d61e8-4d77-4929-a0ad-e8cd2c965ac7 req-82762498-6f33-4089-9651-9b26399f7fb8 service nova] Creating event network-vif-unplugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:11:30 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-442d61e8-4d77-4929-a0ad-e8cd2c965ac7 req-82762498-6f33-4089-9651-9b26399f7fb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034740 Apr 14 03:11:30 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 214/637] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:32 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-129b92d7-61b2-4fc7-94ee-78bd46315ff2 req-c192eecb-30f9-44c0-8649-c9dd8bdae502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-deleted", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-129b92d7-61b2-4fc7-94ee-78bd46315ff2 req-c192eecb-30f9-44c0-8649-c9dd8bdae502 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-129b92d7-61b2-4fc7-94ee-78bd46315ff2 req-c192eecb-30f9-44c0-8649-c9dd8bdae502 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-129b92d7-61b2-4fc7-94ee-78bd46315ff2 req-c192eecb-30f9-44c0-8649-c9dd8bdae502 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:32 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-129b92d7-61b2-4fc7-94ee-78bd46315ff2 req-c192eecb-30f9-44c0-8649-c9dd8bdae502 service nova] Creating event network-vif-deleted:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:11:32 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-129b92d7-61b2-4fc7-94ee-78bd46315ff2 req-c192eecb-30f9-44c0-8649-c9dd8bdae502 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031473 Apr 14 03:11:32 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 211/638] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b5ab8b28-df32-4fe9-84aa-25a2373f00bd req-cd89a5b1-fcfe-4b9d-ae24-bdad587d0c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb082bc-0c74-4149-9bd0-ceb09d7764d4", "name": "network-vif-plugged", "status": "completed", "tag": "04b5c1f1-8988-4a34-b97a-ad0cecd12b71"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b5ab8b28-df32-4fe9-84aa-25a2373f00bd req-cd89a5b1-fcfe-4b9d-ae24-bdad587d0c99 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b5ab8b28-df32-4fe9-84aa-25a2373f00bd req-cd89a5b1-fcfe-4b9d-ae24-bdad587d0c99 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b5ab8b28-df32-4fe9-84aa-25a2373f00bd req-cd89a5b1-fcfe-4b9d-ae24-bdad587d0c99 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b5ab8b28-df32-4fe9-84aa-25a2373f00bd req-cd89a5b1-fcfe-4b9d-ae24-bdad587d0c99 service nova] Creating event network-vif-plugged:04b5c1f1-8988-4a34-b97a-ad0cecd12b71 for instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 on user Apr 14 03:11:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b5ab8b28-df32-4fe9-84aa-25a2373f00bd req-cd89a5b1-fcfe-4b9d-ae24-bdad587d0c99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028612 Apr 14 03:11:32 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 214/639] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: e1493ecb-e6a8-48c5-abf3-d3cbc092736a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] HTTP exception thrown: Instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a could not be found. Apr 14 03:11:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Request method failure captured: Apr 14 03:11:37 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a HTTP/1.1 Apr 14 03:11:37 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:11:37 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:11:37 user devstack@n-api.service[61663]: Connection: close Apr 14 03:11:37 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:11:37 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:11:37 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:11:37 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:11:37 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMOkhglPBD8_hYeo-qfGRUi6934zWZC9zn3oOinaxJBtrz-A-MlpoowGYd50VELUVh1VVnDwStKxeGgMl3zIfEz6Q3QOv6w_WhMqAtj6k1xvbHIWoAsG0IhJJy7nJq8RC-soSCOZI55WaY19hHAHvWFXfXMtViBMGRJ7o5Z-bGvCga4 Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Project-Id: 4549f6080dcf4c739ac03ef643801fbc Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesSnapshotTestJSON-423841644 Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4549f6080dcf4c739ac03ef643801fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4549f6080dcf4c739ac03ef643801fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4549f6080dcf4c739ac03ef643801fbc"}]}] Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesSnapshotTestJSON-423841644 Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Tenant-Id: 4549f6080dcf4c739ac03ef643801fbc Apr 14 03:11:37 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-423841644 Apr 14 03:11:37 user devstack@n-api.service[61663]: X-User: tempest-VolumesSnapshotTestJSON-423841644-project-member Apr 14 03:11:37 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:11:37 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:11:37 user devstack@n-api.service[61663]: X-User-Id: 0128a733bd6a4120addba5eda1cc05fb Apr 14 03:11:37 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesSnapshotTestJSON-423841644-project-member Apr 14 03:11:37 user devstack@n-api.service[61663]: method: > Apr 14 03:11:37 user devstack@n-api.service[61663]: exception: Instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a could not be found. Apr 14 03:11:37 user devstack@n-api.service[61663]: action_args: {'id': 'e1493ecb-e6a8-48c5-abf3-d3cbc092736a'} Apr 14 03:11:37 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a could not be found. Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a could not be found. Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a could not be found. Apr 14 03:11:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Returning 404 to user: Instance e1493ecb-e6a8-48c5-abf3-d3cbc092736a could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:11:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a8b72e12-90d6-4fed-84d6-8050d989f9e0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a" status: 404 len: 111 microversion: 2.1 time: 0.035384 Apr 14 03:11:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 215/640] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:11:36 2023] GET /compute/v2.1/servers/e1493ecb-e6a8-48c5-abf3-d3cbc092736a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:11:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:37 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] HTTP exception thrown: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Request method failure captured: Apr 14 03:11:37 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d HTTP/1.1 Apr 14 03:11:37 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:11:37 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:11:37 user devstack@n-api.service[61662]: Connection: close Apr 14 03:11:37 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:11:37 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:11:37 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:11:37 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:11:37 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEniurR-XYJH0ZsYBHACYc2Zz3VSVL6yUXC8j91UZj78M-vPYDpcO60-6eaqaHLWYpPbpccNUvjFp9pyS_m4sBAblTzSWOml6ZCQK1pdCAcsetJPcy0uVsyqGF5p5SZT3i5ItzPWKpdfOldEDH_gufTZE_3MMAqDqtKJlFrrg7DPAU Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Project-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Project-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/130665008cf648cf87467ae2777a9170"}]}] Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Tenant: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Tenant-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:11:37 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:37 user devstack@n-api.service[61662]: X-User: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:11:37 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:11:37 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:11:37 user devstack@n-api.service[61662]: X-User-Id: d6d78d4991b5493e8893034e91ed407b Apr 14 03:11:37 user devstack@n-api.service[61662]: X-User-Name: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:11:37 user devstack@n-api.service[61662]: method: > Apr 14 03:11:37 user devstack@n-api.service[61662]: exception: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:37 user devstack@n-api.service[61662]: action_args: {'id': '9c4bbe1e-d297-40e2-95d5-d8ab381c302d'} Apr 14 03:11:37 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:37 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Returning 404 to user: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:11:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-9bc5a663-6d70-4f03-802c-53e0f57cbb10 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d" status: 404 len: 111 microversion: 2.1 time: 0.032043 Apr 14 03:11:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 212/641] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:11:37 2023] DELETE /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:11:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:37 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: 9c4bbe1e-d297-40e2-95d5-d8ab381c302d] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] HTTP exception thrown: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Request method failure captured: Apr 14 03:11:37 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d HTTP/1.1 Apr 14 03:11:37 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:11:37 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:11:37 user devstack@n-api.service[61664]: Connection: close Apr 14 03:11:37 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:11:37 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:11:37 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:11:37 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:11:37 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEniurR-XYJH0ZsYBHACYc2Zz3VSVL6yUXC8j91UZj78M-vPYDpcO60-6eaqaHLWYpPbpccNUvjFp9pyS_m4sBAblTzSWOml6ZCQK1pdCAcsetJPcy0uVsyqGF5p5SZT3i5ItzPWKpdfOldEDH_gufTZE_3MMAqDqtKJlFrrg7DPAU Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Project-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/130665008cf648cf87467ae2777a9170"}]}] Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Tenant-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:11:37 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:37 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:11:37 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:11:37 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:11:37 user devstack@n-api.service[61664]: X-User-Id: d6d78d4991b5493e8893034e91ed407b Apr 14 03:11:37 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:11:37 user devstack@n-api.service[61664]: method: > Apr 14 03:11:37 user devstack@n-api.service[61664]: exception: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:37 user devstack@n-api.service[61664]: action_args: {'id': '9c4bbe1e-d297-40e2-95d5-d8ab381c302d'} Apr 14 03:11:37 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. Apr 14 03:11:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Returning 404 to user: Instance 9c4bbe1e-d297-40e2-95d5-d8ab381c302d could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:11:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3adb29c3-66ef-4f6c-9a5e-df8426479f1c tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d" status: 404 len: 111 microversion: 2.1 time: 0.028116 Apr 14 03:11:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 215/642] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:11:37 2023] GET /compute/v2.1/servers/9c4bbe1e-d297-40e2-95d5-d8ab381c302d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3dd041a5-a5e3-457b-9ff2-33992268856c tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3dd041a5-a5e3-457b-9ff2-33992268856c tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3dd041a5-a5e3-457b-9ff2-33992268856c tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3dd041a5-a5e3-457b-9ff2-33992268856c tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3dd041a5-a5e3-457b-9ff2-33992268856c tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3dd041a5-a5e3-457b-9ff2-33992268856c tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3dd041a5-a5e3-457b-9ff2-33992268856c tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3dd041a5-a5e3-457b-9ff2-33992268856c tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3dd041a5-a5e3-457b-9ff2-33992268856c tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a/action" status: 202 len: 0 microversion: 2.87 time: 0.086878 Apr 14 03:11:40 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 216/643] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 03:11:40 2023] POST /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:11:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-7be34e2e-e650-4458-b7d1-c3ca3ec6d27e tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a" status: 200 len: 1764 microversion: 2.87 time: 0.299149 Apr 14 03:11:40 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 213/644] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:11:40 2023] GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a => generated 1764 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:11:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:40 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] HTTP exception thrown: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:11:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Request method failure captured: Apr 14 03:11:40 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 HTTP/1.1 Apr 14 03:11:40 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:11:40 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:11:40 user devstack@n-api.service[61664]: Connection: close Apr 14 03:11:40 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:11:40 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:11:40 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:11:40 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:11:40 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEniurR-XYJH0ZsYBHACYc2Zz3VSVL6yUXC8j91UZj78M-vPYDpcO60-6eaqaHLWYpPbpccNUvjFp9pyS_m4sBAblTzSWOml6ZCQK1pdCAcsetJPcy0uVsyqGF5p5SZT3i5ItzPWKpdfOldEDH_gufTZE_3MMAqDqtKJlFrrg7DPAU Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Project-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/130665008cf648cf87467ae2777a9170"}]}] Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Tenant-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:11:40 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:40 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:11:40 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:11:40 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:11:40 user devstack@n-api.service[61664]: X-User-Id: d6d78d4991b5493e8893034e91ed407b Apr 14 03:11:40 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:11:40 user devstack@n-api.service[61664]: method: > Apr 14 03:11:40 user devstack@n-api.service[61664]: exception: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:11:40 user devstack@n-api.service[61664]: action_args: {'id': 'bbb6cd58-ce7a-43ae-876d-51a888193f60'} Apr 14 03:11:40 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:11:40 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:11:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Returning 404 to user: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:11:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f169bc98-302a-436d-977e-1a2fed8a9cc4 tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 404 len: 111 microversion: 2.1 time: 0.037723 Apr 14 03:11:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 216/645] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:11:40 2023] DELETE /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] [instance: bbb6cd58-ce7a-43ae-876d-51a888193f60] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-fb9cf409-d540-45e8-9e14-7216c75d1e85 req-31b02940-8bd3-4b8f-a4bc-35bd3ef925be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-fb9cf409-d540-45e8-9e14-7216c75d1e85 req-31b02940-8bd3-4b8f-a4bc-35bd3ef925be service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-fb9cf409-d540-45e8-9e14-7216c75d1e85 req-31b02940-8bd3-4b8f-a4bc-35bd3ef925be service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-fb9cf409-d540-45e8-9e14-7216c75d1e85 req-31b02940-8bd3-4b8f-a4bc-35bd3ef925be service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] HTTP exception thrown: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:11:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Request method failure captured: Apr 14 03:11:41 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 HTTP/1.1 Apr 14 03:11:41 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:11:41 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:11:41 user devstack@n-api.service[61662]: Connection: close Apr 14 03:11:41 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:11:41 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:11:41 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:11:41 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:11:41 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEniurR-XYJH0ZsYBHACYc2Zz3VSVL6yUXC8j91UZj78M-vPYDpcO60-6eaqaHLWYpPbpccNUvjFp9pyS_m4sBAblTzSWOml6ZCQK1pdCAcsetJPcy0uVsyqGF5p5SZT3i5ItzPWKpdfOldEDH_gufTZE_3MMAqDqtKJlFrrg7DPAU Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Project-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Project-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/130665008cf648cf87467ae2777a9170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/130665008cf648cf87467ae2777a9170"}]}] Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Tenant: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Tenant-Id: 130665008cf648cf87467ae2777a9170 Apr 14 03:11:41 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975876676 Apr 14 03:11:41 user devstack@n-api.service[61662]: X-User: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:11:41 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:11:41 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:11:41 user devstack@n-api.service[61662]: X-User-Id: d6d78d4991b5493e8893034e91ed407b Apr 14 03:11:41 user devstack@n-api.service[61662]: X-User-Name: tempest-AttachVolumeTestJSON-975876676-project-member Apr 14 03:11:41 user devstack@n-api.service[61662]: method: > Apr 14 03:11:41 user devstack@n-api.service[61662]: exception: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:11:41 user devstack@n-api.service[61662]: action_args: {'id': 'bbb6cd58-ce7a-43ae-876d-51a888193f60'} Apr 14 03:11:41 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. Apr 14 03:11:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:11:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] Returning 404 to user: Instance bbb6cd58-ce7a-43ae-876d-51a888193f60 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:11:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c07ef1a5-6498-4e2e-a3ed-0ae2bdbff41b tempest-AttachVolumeTestJSON-975876676 tempest-AttachVolumeTestJSON-975876676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60" status: 404 len: 111 microversion: 2.1 time: 0.035154 Apr 14 03:11:41 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 214/646] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:11:40 2023] GET /compute/v2.1/servers/bbb6cd58-ce7a-43ae-876d-51a888193f60 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:11:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-fb9cf409-d540-45e8-9e14-7216c75d1e85 req-31b02940-8bd3-4b8f-a4bc-35bd3ef925be service nova] Creating event network-vif-unplugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:11:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-fb9cf409-d540-45e8-9e14-7216c75d1e85 req-31b02940-8bd3-4b8f-a4bc-35bd3ef925be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046453 Apr 14 03:11:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 217/647] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9286c142-9537-4ddd-935a-15b5f36e1734 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:41 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9286c142-9537-4ddd-935a-15b5f36e1734 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7f542934-641f-405f-811c-3601a3be389b] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9286c142-9537-4ddd-935a-15b5f36e1734 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9286c142-9537-4ddd-935a-15b5f36e1734 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9286c142-9537-4ddd-935a-15b5f36e1734 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9286c142-9537-4ddd-935a-15b5f36e1734 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9286c142-9537-4ddd-935a-15b5f36e1734 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9286c142-9537-4ddd-935a-15b5f36e1734 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:42 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-9286c142-9537-4ddd-935a-15b5f36e1734 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:11:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9286c142-9537-4ddd-935a-15b5f36e1734 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b" status: 200 len: 1442 microversion: 2.1 time: 0.655279 Apr 14 03:11:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 217/648] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:11:41 2023] GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b => generated 1442 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:11:43 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}, {"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}, {"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}, {"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}, {"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}, {"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:11:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:11:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:11:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] Creating event network-vif-unplugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:11:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:11:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:11:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-c666cc07-c350-4896-89de-686fdedaf1bc req-9f6a85ce-d5cb-42f8-a4d2-f1826350bf8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.039958 Apr 14 03:11:43 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 215/649] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:43 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:11:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-03d50509-4303-4148-99e7-9dfe31100d37 req-0192336d-4b41-4845-81d3-a2e0099381c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-03d50509-4303-4148-99e7-9dfe31100d37 req-0192336d-4b41-4845-81d3-a2e0099381c8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-03d50509-4303-4148-99e7-9dfe31100d37 req-0192336d-4b41-4845-81d3-a2e0099381c8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-03d50509-4303-4148-99e7-9dfe31100d37 req-0192336d-4b41-4845-81d3-a2e0099381c8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-03d50509-4303-4148-99e7-9dfe31100d37 req-0192336d-4b41-4845-81d3-a2e0099381c8 service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:11:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-03d50509-4303-4148-99e7-9dfe31100d37 req-0192336d-4b41-4845-81d3-a2e0099381c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050807 Apr 14 03:11:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 218/650] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1353831390", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "bdc97991-26cc-4e5b-8d38-a1f750e7dd2c"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] validate_networks() for [('bdc97991-26cc-4e5b-8d38-a1f750e7dd2c', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Getting quotas for project 4549f6080dcf4c739ac03ef643801fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Getting quotas for user 0128a733bd6a4120addba5eda1cc05fb and project 4549f6080dcf4c739ac03ef643801fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:11:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: 0708e26d-9d20-4cb0-9b8c-76249f74f0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:11:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-aa7a4c74-3dfc-4ece-b627-361d18ed3f98 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.598986 Apr 14 03:11:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 218/651] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:11:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:11:50 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b3062a38-4188-48b5-8f22-97dd51d81eff tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:50 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-b3062a38-4188-48b5-8f22-97dd51d81eff tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: 0708e26d-9d20-4cb0-9b8c-76249f74f0a2] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:51 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-b3062a38-4188-48b5-8f22-97dd51d81eff tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0128a733bd6a4120addba5eda1cc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4549f6080dcf4c739ac03ef643801fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:11:51 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b3062a38-4188-48b5-8f22-97dd51d81eff tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2" status: 200 len: 1213 microversion: 2.1 time: 0.071975 Apr 14 03:11:51 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 216/652] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:11:50 2023] GET /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:11:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3e72b0e6-2368-4dc7-ac4c-a63573a71955 req-51fda451-0e0f-40b0-b318-b205d1f12872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0708e26d-9d20-4cb0-9b8c-76249f74f0a2", "tag": "6f05389c-b6d4-40ce-afa3-06e781a35ba5"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3e72b0e6-2368-4dc7-ac4c-a63573a71955 req-51fda451-0e0f-40b0-b318-b205d1f12872 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3e72b0e6-2368-4dc7-ac4c-a63573a71955 req-51fda451-0e0f-40b0-b318-b205d1f12872 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3e72b0e6-2368-4dc7-ac4c-a63573a71955 req-51fda451-0e0f-40b0-b318-b205d1f12872 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3e72b0e6-2368-4dc7-ac4c-a63573a71955 req-51fda451-0e0f-40b0-b318-b205d1f12872 service nova] Creating event network-changed:6f05389c-b6d4-40ce-afa3-06e781a35ba5 for instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 on user Apr 14 03:11:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3e72b0e6-2368-4dc7-ac4c-a63573a71955 req-51fda451-0e0f-40b0-b318-b205d1f12872 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033129 Apr 14 03:11:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 219/653] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-3b9a09d8-2645-442a-82e5-20e003830444 req-1f99ac62-9e87-4fc7-898f-ffbcd9c76b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0708e26d-9d20-4cb0-9b8c-76249f74f0a2", "name": "network-vif-plugged", "status": "completed", "tag": "6f05389c-b6d4-40ce-afa3-06e781a35ba5"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3b9a09d8-2645-442a-82e5-20e003830444 req-1f99ac62-9e87-4fc7-898f-ffbcd9c76b23 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3b9a09d8-2645-442a-82e5-20e003830444 req-1f99ac62-9e87-4fc7-898f-ffbcd9c76b23 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3b9a09d8-2645-442a-82e5-20e003830444 req-1f99ac62-9e87-4fc7-898f-ffbcd9c76b23 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-3b9a09d8-2645-442a-82e5-20e003830444 req-1f99ac62-9e87-4fc7-898f-ffbcd9c76b23 service nova] Creating event network-vif-plugged:6f05389c-b6d4-40ce-afa3-06e781a35ba5 for instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 on user Apr 14 03:11:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-3b9a09d8-2645-442a-82e5-20e003830444 req-1f99ac62-9e87-4fc7-898f-ffbcd9c76b23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028303 Apr 14 03:11:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 219/654] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-da731d5c-e69f-4929-8420-52d432b5329e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:56 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-da731d5c-e69f-4929-8420-52d432b5329e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:56 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-da731d5c-e69f-4929-8420-52d432b5329e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-da731d5c-e69f-4929-8420-52d432b5329e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-da731d5c-e69f-4929-8420-52d432b5329e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-da731d5c-e69f-4929-8420-52d432b5329e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-da731d5c-e69f-4929-8420-52d432b5329e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-da731d5c-e69f-4929-8420-52d432b5329e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:57 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-da731d5c-e69f-4929-8420-52d432b5329e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.117980 Apr 14 03:11:57 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 217/655] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:11:56 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-interface => generated 283 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-35cd6664-a9b1-4524-ba1e-79c4e7ce8359 req-43780a10-ff12-4b11-966d-48e78dfdd77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0708e26d-9d20-4cb0-9b8c-76249f74f0a2", "name": "network-vif-plugged", "status": "completed", "tag": "6f05389c-b6d4-40ce-afa3-06e781a35ba5"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-35cd6664-a9b1-4524-ba1e-79c4e7ce8359 req-43780a10-ff12-4b11-966d-48e78dfdd77f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-35cd6664-a9b1-4524-ba1e-79c4e7ce8359 req-43780a10-ff12-4b11-966d-48e78dfdd77f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-35cd6664-a9b1-4524-ba1e-79c4e7ce8359 req-43780a10-ff12-4b11-966d-48e78dfdd77f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-35cd6664-a9b1-4524-ba1e-79c4e7ce8359 req-43780a10-ff12-4b11-966d-48e78dfdd77f service nova] Creating event network-vif-plugged:6f05389c-b6d4-40ce-afa3-06e781a35ba5 for instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 on user Apr 14 03:11:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-35cd6664-a9b1-4524-ba1e-79c4e7ce8359 req-43780a10-ff12-4b11-966d-48e78dfdd77f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061352 Apr 14 03:11:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 220/656] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-0e090c34-e8dc-45fd-906b-77ba89345e0b req-13ca3962-514d-42d9-9fbb-5819fd535a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0e090c34-e8dc-45fd-906b-77ba89345e0b req-13ca3962-514d-42d9-9fbb-5819fd535a3e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0e090c34-e8dc-45fd-906b-77ba89345e0b req-13ca3962-514d-42d9-9fbb-5819fd535a3e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0e090c34-e8dc-45fd-906b-77ba89345e0b req-13ca3962-514d-42d9-9fbb-5819fd535a3e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0e090c34-e8dc-45fd-906b-77ba89345e0b req-13ca3962-514d-42d9-9fbb-5819fd535a3e service nova] Creating event network-changed:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:11:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-0e090c34-e8dc-45fd-906b-77ba89345e0b req-13ca3962-514d-42d9-9fbb-5819fd535a3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034497 Apr 14 03:11:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 220/657] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:11:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:11:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-560fbb1f-0326-4d8d-9983-a9c92e3540ff tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-130746631"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:11:58 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-560fbb1f-0326-4d8d-9983-a9c92e3540ff tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:11:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-560fbb1f-0326-4d8d-9983-a9c92e3540ff tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-560fbb1f-0326-4d8d-9983-a9c92e3540ff tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-560fbb1f-0326-4d8d-9983-a9c92e3540ff tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-560fbb1f-0326-4d8d-9983-a9c92e3540ff tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:11:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-560fbb1f-0326-4d8d-9983-a9c92e3540ff tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:11:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-560fbb1f-0326-4d8d-9983-a9c92e3540ff tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:11:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-560fbb1f-0326-4d8d-9983-a9c92e3540ff tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/action" status: 202 len: 0 microversion: 2.1 time: 0.906597 Apr 14 03:11:59 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 218/658] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:11:58 2023] POST /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/action => generated 0 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 03:11:59 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bc7f19b0-2c32-4eaf-8337-acb78f9ca9a7 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '.version_select at 0x7ff11a23e3b0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:11:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-bc7f19b0-2c32-4eaf-8337-acb78f9ca9a7 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/images/b96871c7-2eee-43a3-82b5-3a0299fdd7a8" status: 200 len: 1610 microversion: 2.1 time: 0.056692 Apr 14 03:11:59 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 221/659] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 03:11:59 2023] GET /compute/v2.1/images/b96871c7-2eee-43a3-82b5-3a0299fdd7a8 => generated 1610 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-56dfb558-4825-4fe4-b712-617651669c76 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-56dfb558-4825-4fe4-b712-617651669c76 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=26 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-56dfb558-4825-4fe4-b712-617651669c76 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-56dfb558-4825-4fe4-b712-617651669c76 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-56dfb558-4825-4fe4-b712-617651669c76 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-56dfb558-4825-4fe4-b712-617651669c76 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-56dfb558-4825-4fe4-b712-617651669c76 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-56dfb558-4825-4fe4-b712-617651669c76 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-56dfb558-4825-4fe4-b712-617651669c76 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.097419 Apr 14 03:12:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 221/660] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:12:12 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-interface => generated 282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:12:13 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:13 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:13 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:13 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-355fcf83-00bf-4ab3-8eb3-283e1fef6d8d req-cdc18c60-9388-404c-abc8-b66a3dc23f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-355fcf83-00bf-4ab3-8eb3-283e1fef6d8d req-cdc18c60-9388-404c-abc8-b66a3dc23f74 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-355fcf83-00bf-4ab3-8eb3-283e1fef6d8d req-cdc18c60-9388-404c-abc8-b66a3dc23f74 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-355fcf83-00bf-4ab3-8eb3-283e1fef6d8d req-cdc18c60-9388-404c-abc8-b66a3dc23f74 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:13 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-355fcf83-00bf-4ab3-8eb3-283e1fef6d8d req-cdc18c60-9388-404c-abc8-b66a3dc23f74 service nova] Creating event network-changed:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:12:13 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-355fcf83-00bf-4ab3-8eb3-283e1fef6d8d req-cdc18c60-9388-404c-abc8-b66a3dc23f74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052035 Apr 14 03:12:13 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 219/661] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:12:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:13 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lazy-loading 'services' on Instance uuid 4e47adee-bd94-4655-9bbd-ed59c5478531 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:12:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments/05d362e8-1aaf-4bbb-8a9f-9f153920e00c" status: 202 len: 0 microversion: 2.1 time: 0.190642 Apr 14 03:12:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 222/662] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:12:13 2023] DELETE /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments/05d362e8-1aaf-4bbb-8a9f-9f153920e00c => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:12:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-cc216e58-712b-4c04-a7c4-b7b636e7aeed tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:14 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-cc216e58-712b-4c04-a7c4-b7b636e7aeed tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cc216e58-712b-4c04-a7c4-b7b636e7aeed tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cc216e58-712b-4c04-a7c4-b7b636e7aeed tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cc216e58-712b-4c04-a7c4-b7b636e7aeed tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cc216e58-712b-4c04-a7c4-b7b636e7aeed tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cc216e58-712b-4c04-a7c4-b7b636e7aeed tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cc216e58-712b-4c04-a7c4-b7b636e7aeed tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-cc216e58-712b-4c04-a7c4-b7b636e7aeed tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 Apr 14 03:12:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 222/663] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:12:14 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:12:15 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-ce63d06d-812b-4e0c-a7fc-406b5f8c189a req-9a3235a2-b7c2-4520-a85c-aa2de76c4cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ce63d06d-812b-4e0c-a7fc-406b5f8c189a req-9a3235a2-b7c2-4520-a85c-aa2de76c4cd9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ce63d06d-812b-4e0c-a7fc-406b5f8c189a req-9a3235a2-b7c2-4520-a85c-aa2de76c4cd9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ce63d06d-812b-4e0c-a7fc-406b5f8c189a req-9a3235a2-b7c2-4520-a85c-aa2de76c4cd9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-ce63d06d-812b-4e0c-a7fc-406b5f8c189a req-9a3235a2-b7c2-4520-a85c-aa2de76c4cd9 service nova] Creating event network-changed:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:12:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-ce63d06d-812b-4e0c-a7fc-406b5f8c189a req-9a3235a2-b7c2-4520-a85c-aa2de76c4cd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028918 Apr 14 03:12:15 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 220/664] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:12:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:12:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b3ec2471-15f5-4ace-b779-7758f3c40505 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b3ec2471-15f5-4ace-b779-7758f3c40505 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: 1840cf40-2228-4506-9a3f-0c9d29373533] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b3ec2471-15f5-4ace-b779-7758f3c40505 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b3ec2471-15f5-4ace-b779-7758f3c40505 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b3ec2471-15f5-4ace-b779-7758f3c40505 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b3ec2471-15f5-4ace-b779-7758f3c40505 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b3ec2471-15f5-4ace-b779-7758f3c40505 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b3ec2471-15f5-4ace-b779-7758f3c40505 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b3ec2471-15f5-4ace-b779-7758f3c40505 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: 1840cf40-2228-4506-9a3f-0c9d29373533] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:12:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b3ec2471-15f5-4ace-b779-7758f3c40505 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533" status: 204 len: 0 microversion: 2.1 time: 0.127732 Apr 14 03:12:17 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 223/665] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:12:16 2023] DELETE /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:12:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4ddf38b3-44a6-46d3-adc6-34a3b5260025 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:17 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4ddf38b3-44a6-46d3-adc6-34a3b5260025 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: 1840cf40-2228-4506-9a3f-0c9d29373533] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4ddf38b3-44a6-46d3-adc6-34a3b5260025 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4ddf38b3-44a6-46d3-adc6-34a3b5260025 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4ddf38b3-44a6-46d3-adc6-34a3b5260025 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4ddf38b3-44a6-46d3-adc6-34a3b5260025 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4ddf38b3-44a6-46d3-adc6-34a3b5260025 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4ddf38b3-44a6-46d3-adc6-34a3b5260025 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:17 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-4ddf38b3-44a6-46d3-adc6-34a3b5260025 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2facbf385e8402c86706cc28d4707af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318728a20064d49b9c1b2f89175a364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:12:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4ddf38b3-44a6-46d3-adc6-34a3b5260025 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533" status: 200 len: 1491 microversion: 2.1 time: 0.315859 Apr 14 03:12:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 223/666] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:12:17 2023] GET /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533 => generated 1491 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:12:17 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-d1a7ce39-94de-4b47-8dba-7d8f9454645b req-7ebc9195-53ac-4e44-ab1e-68318397a270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1840cf40-2228-4506-9a3f-0c9d29373533", "name": "network-vif-unplugged", "status": "completed", "tag": "6c925a4c-0f5a-4711-92b2-7440a5170256"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d1a7ce39-94de-4b47-8dba-7d8f9454645b req-7ebc9195-53ac-4e44-ab1e-68318397a270 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d1a7ce39-94de-4b47-8dba-7d8f9454645b req-7ebc9195-53ac-4e44-ab1e-68318397a270 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d1a7ce39-94de-4b47-8dba-7d8f9454645b req-7ebc9195-53ac-4e44-ab1e-68318397a270 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:17 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-d1a7ce39-94de-4b47-8dba-7d8f9454645b req-7ebc9195-53ac-4e44-ab1e-68318397a270 service nova] Creating event network-vif-unplugged:6c925a4c-0f5a-4711-92b2-7440a5170256 for instance 1840cf40-2228-4506-9a3f-0c9d29373533 on user Apr 14 03:12:17 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-d1a7ce39-94de-4b47-8dba-7d8f9454645b req-7ebc9195-53ac-4e44-ab1e-68318397a270 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033463 Apr 14 03:12:17 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 221/667] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:12:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:12:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3b8bb0a0-f860-4660-a1f8-e381c5541438 req-c738abae-41bb-4430-a86d-02f56822f620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1840cf40-2228-4506-9a3f-0c9d29373533", "name": "network-vif-deleted", "tag": "6c925a4c-0f5a-4711-92b2-7440a5170256"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3b8bb0a0-f860-4660-a1f8-e381c5541438 req-c738abae-41bb-4430-a86d-02f56822f620 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3b8bb0a0-f860-4660-a1f8-e381c5541438 req-c738abae-41bb-4430-a86d-02f56822f620 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3b8bb0a0-f860-4660-a1f8-e381c5541438 req-c738abae-41bb-4430-a86d-02f56822f620 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3b8bb0a0-f860-4660-a1f8-e381c5541438 req-c738abae-41bb-4430-a86d-02f56822f620 service nova] Creating event network-vif-deleted:6c925a4c-0f5a-4711-92b2-7440a5170256 for instance 1840cf40-2228-4506-9a3f-0c9d29373533 on user Apr 14 03:12:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3b8bb0a0-f860-4660-a1f8-e381c5541438 req-c738abae-41bb-4430-a86d-02f56822f620 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030868 Apr 14 03:12:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 224/668] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:12:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:12:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-0ca9d075-4555-4d3a-9704-c6a265335ab5 req-b4c76b09-c5e3-43f4-b799-309a2a9607d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1840cf40-2228-4506-9a3f-0c9d29373533", "name": "network-vif-plugged", "status": "completed", "tag": "6c925a4c-0f5a-4711-92b2-7440a5170256"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0ca9d075-4555-4d3a-9704-c6a265335ab5 req-b4c76b09-c5e3-43f4-b799-309a2a9607d4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0ca9d075-4555-4d3a-9704-c6a265335ab5 req-b4c76b09-c5e3-43f4-b799-309a2a9607d4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0ca9d075-4555-4d3a-9704-c6a265335ab5 req-b4c76b09-c5e3-43f4-b799-309a2a9607d4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0ca9d075-4555-4d3a-9704-c6a265335ab5 req-b4c76b09-c5e3-43f4-b799-309a2a9607d4 service nova] Creating event network-vif-plugged:6c925a4c-0f5a-4711-92b2-7440a5170256 for instance 1840cf40-2228-4506-9a3f-0c9d29373533 on user Apr 14 03:12:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-0ca9d075-4555-4d3a-9704-c6a265335ab5 req-b4c76b09-c5e3-43f4-b799-309a2a9607d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039487 Apr 14 03:12:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 224/669] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:12:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:20 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] HTTP exception thrown: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Request method failure captured: Apr 14 03:12:20 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 HTTP/1.1 Apr 14 03:12:20 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:12:20 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:12:20 user devstack@n-api.service[61662]: Connection: close Apr 14 03:12:20 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:12:20 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:12:20 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:12:20 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:12:20 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEwNUgCimNYsQbBjNY65naesttf0DOIlIFsruFgOMPWUh9n__eJwNwzTfqsJ4pG6NctcV45i2hbejZLxJTqrHVdKL3k46KNVTFVtMghDaOPE_t4cqOxjSXOhHO_7WF7yR1Razi5RuuynO_-0mB1kL1eM-jN7S65s5A44Fbd5tq0Lwg Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Project-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Project-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4075885e26cb4adaad24d3ae6217fe35"}]}] Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Tenant: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Tenant-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:12:20 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:12:20 user devstack@n-api.service[61662]: X-User: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:12:20 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:12:20 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:12:20 user devstack@n-api.service[61662]: X-User-Id: 7dea23743ba945c4a9d539b8e277c653 Apr 14 03:12:20 user devstack@n-api.service[61662]: X-User-Name: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:12:20 user devstack@n-api.service[61662]: method: > Apr 14 03:12:20 user devstack@n-api.service[61662]: exception: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61662]: action_args: {'id': '6bb082bc-0c74-4149-9bd0-ceb09d7764d4'} Apr 14 03:12:20 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Returning 404 to user: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:12:20 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-641ac676-c0a5-4df0-b2af-b39535e204b7 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 404 len: 111 microversion: 2.1 time: 0.028031 Apr 14 03:12:20 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 222/670] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:12:20 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:12:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:20 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] HTTP exception thrown: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Request method failure captured: Apr 14 03:12:20 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments HTTP/1.1 Apr 14 03:12:20 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:12:20 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:12:20 user devstack@n-api.service[61663]: Connection: close Apr 14 03:12:20 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:12:20 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:12:20 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:12:20 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:12:20 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMEwNUgCimNYsQbBjNY65naesttf0DOIlIFsruFgOMPWUh9n__eJwNwzTfqsJ4pG6NctcV45i2hbejZLxJTqrHVdKL3k46KNVTFVtMghDaOPE_t4cqOxjSXOhHO_7WF7yR1Razi5RuuynO_-0mB1kL1eM-jN7S65s5A44Fbd5tq0Lwg Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Project-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4075885e26cb4adaad24d3ae6217fe35"}]}] Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Tenant-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:12:20 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:12:20 user devstack@n-api.service[61663]: X-User: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:12:20 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:12:20 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:12:20 user devstack@n-api.service[61663]: X-User-Id: 7dea23743ba945c4a9d539b8e277c653 Apr 14 03:12:20 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:12:20 user devstack@n-api.service[61663]: method: > Apr 14 03:12:20 user devstack@n-api.service[61663]: exception: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61663]: action_args: {'server_id': '6bb082bc-0c74-4149-9bd0-ceb09d7764d4'} Apr 14 03:12:20 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Returning 404 to user: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:12:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e49cfc73-51c2-4e9e-9865-24466f36ea18 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037073 Apr 14 03:12:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 225/671] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:12:20 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:12:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:20 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] HTTP exception thrown: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Request method failure captured: Apr 14 03:12:20 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 HTTP/1.1 Apr 14 03:12:20 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:12:20 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:12:20 user devstack@n-api.service[61664]: Connection: close Apr 14 03:12:20 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:12:20 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:12:20 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:12:20 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:12:20 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEwNUgCimNYsQbBjNY65naesttf0DOIlIFsruFgOMPWUh9n__eJwNwzTfqsJ4pG6NctcV45i2hbejZLxJTqrHVdKL3k46KNVTFVtMghDaOPE_t4cqOxjSXOhHO_7WF7yR1Razi5RuuynO_-0mB1kL1eM-jN7S65s5A44Fbd5tq0Lwg Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Project-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4075885e26cb4adaad24d3ae6217fe35"}]}] Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Tenant-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:12:20 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:12:20 user devstack@n-api.service[61664]: X-User: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:12:20 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:12:20 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:12:20 user devstack@n-api.service[61664]: X-User-Id: 7dea23743ba945c4a9d539b8e277c653 Apr 14 03:12:20 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:12:20 user devstack@n-api.service[61664]: method: > Apr 14 03:12:20 user devstack@n-api.service[61664]: exception: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61664]: action_args: {'id': '6bb082bc-0c74-4149-9bd0-ceb09d7764d4'} Apr 14 03:12:20 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:12:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:12:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Returning 404 to user: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:12:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9d25c6ff-5024-448c-8e8b-4ccd37171028 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 404 len: 111 microversion: 2.1 time: 0.033160 Apr 14 03:12:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 225/672] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:12:20 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:12:20 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-207746006", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "e6bbbad8-4a73-4b93-8464-08be8f6681de"}], "security_groups": [{"name": "tempest-securitygroup--1450832286"}], "key_name": "tempest-keypair-368632906", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] validate_networks() for [('e6bbbad8-4a73-4b93-8464-08be8f6681de', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for user 7dea23743ba945c4a9d539b8e277c653 and project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:12:21 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 24d1359d-2dcd-46d7-90f3-3801df9be357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:12:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-2ff94d75-f234-4cdf-bdfe-ad3adc79e2f3 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.830951 Apr 14 03:12:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 223/673] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:12:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:12:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ba40da2b-987f-4554-a1ed-0244c4764f01 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:21 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ba40da2b-987f-4554-a1ed-0244c4764f01 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 24d1359d-2dcd-46d7-90f3-3801df9be357] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:21 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-ba40da2b-987f-4554-a1ed-0244c4764f01 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:12:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ba40da2b-987f-4554-a1ed-0244c4764f01 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357" status: 200 len: 1231 microversion: 2.1 time: 0.070240 Apr 14 03:12:21 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 226/674] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:12:21 2023] GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357 => generated 1231 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 03:12:24 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d2130da3-436f-486b-8625-7d76227697a4 req-cb925e25-0591-43c5-90cc-aaaab6b79def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d1359d-2dcd-46d7-90f3-3801df9be357", "tag": "6ea4c00e-5d4b-4375-9b8d-60177a6ec526"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d2130da3-436f-486b-8625-7d76227697a4 req-cb925e25-0591-43c5-90cc-aaaab6b79def service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d2130da3-436f-486b-8625-7d76227697a4 req-cb925e25-0591-43c5-90cc-aaaab6b79def service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d2130da3-436f-486b-8625-7d76227697a4 req-cb925e25-0591-43c5-90cc-aaaab6b79def service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d2130da3-436f-486b-8625-7d76227697a4 req-cb925e25-0591-43c5-90cc-aaaab6b79def service nova] Creating event network-changed:6ea4c00e-5d4b-4375-9b8d-60177a6ec526 for instance 24d1359d-2dcd-46d7-90f3-3801df9be357 on user Apr 14 03:12:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d2130da3-436f-486b-8625-7d76227697a4 req-cb925e25-0591-43c5-90cc-aaaab6b79def service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032160 Apr 14 03:12:24 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 226/675] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:12:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:12:26 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-3c041257-6f24-410c-89b1-e7d807ad8c90 req-eccfdc88-4099-4fcd-8ab7-517bc1a10600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d1359d-2dcd-46d7-90f3-3801df9be357", "name": "network-vif-plugged", "status": "completed", "tag": "6ea4c00e-5d4b-4375-9b8d-60177a6ec526"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-3c041257-6f24-410c-89b1-e7d807ad8c90 req-eccfdc88-4099-4fcd-8ab7-517bc1a10600 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-3c041257-6f24-410c-89b1-e7d807ad8c90 req-eccfdc88-4099-4fcd-8ab7-517bc1a10600 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:26 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-3c041257-6f24-410c-89b1-e7d807ad8c90 req-eccfdc88-4099-4fcd-8ab7-517bc1a10600 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-3c041257-6f24-410c-89b1-e7d807ad8c90 req-eccfdc88-4099-4fcd-8ab7-517bc1a10600 service nova] Creating event network-vif-plugged:6ea4c00e-5d4b-4375-9b8d-60177a6ec526 for instance 24d1359d-2dcd-46d7-90f3-3801df9be357 on user Apr 14 03:12:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-3c041257-6f24-410c-89b1-e7d807ad8c90 req-eccfdc88-4099-4fcd-8ab7-517bc1a10600 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036905 Apr 14 03:12:26 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 224/676] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:12:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:12:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-98d2f1e4-97cc-4def-be0d-763673364e1c req-8f3c5aad-3a62-4737-9d7a-09ecf8ed4be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d1359d-2dcd-46d7-90f3-3801df9be357", "name": "network-vif-plugged", "status": "completed", "tag": "6ea4c00e-5d4b-4375-9b8d-60177a6ec526"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-98d2f1e4-97cc-4def-be0d-763673364e1c req-8f3c5aad-3a62-4737-9d7a-09ecf8ed4be3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-98d2f1e4-97cc-4def-be0d-763673364e1c req-8f3c5aad-3a62-4737-9d7a-09ecf8ed4be3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-98d2f1e4-97cc-4def-be0d-763673364e1c req-8f3c5aad-3a62-4737-9d7a-09ecf8ed4be3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-98d2f1e4-97cc-4def-be0d-763673364e1c req-8f3c5aad-3a62-4737-9d7a-09ecf8ed4be3 service nova] Creating event network-vif-plugged:6ea4c00e-5d4b-4375-9b8d-60177a6ec526 for instance 24d1359d-2dcd-46d7-90f3-3801df9be357 on user Apr 14 03:12:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-98d2f1e4-97cc-4def-be0d-763673364e1c req-8f3c5aad-3a62-4737-9d7a-09ecf8ed4be3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074908 Apr 14 03:12:28 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 227/677] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:12:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:12:30 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:12:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7134f215-fab9-47db-b40c-6545456df982 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a" status: 200 len: 1770 microversion: 2.87 time: 0.158344 Apr 14 03:12:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 227/678] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:12:30 2023] GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a => generated 1770 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=12 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-0a2bec83-ba6f-49e7-9499-fd4fe7fa2851 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-0a2bec83-ba6f-49e7-9499-fd4fe7fa2851 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: 0708e26d-9d20-4cb0-9b8c-76249f74f0a2] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0a2bec83-ba6f-49e7-9499-fd4fe7fa2851 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0a2bec83-ba6f-49e7-9499-fd4fe7fa2851 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0a2bec83-ba6f-49e7-9499-fd4fe7fa2851 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0a2bec83-ba6f-49e7-9499-fd4fe7fa2851 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0a2bec83-ba6f-49e7-9499-fd4fe7fa2851 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0a2bec83-ba6f-49e7-9499-fd4fe7fa2851 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:41 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-0a2bec83-ba6f-49e7-9499-fd4fe7fa2851 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0128a733bd6a4120addba5eda1cc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4549f6080dcf4c739ac03ef643801fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:12:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-0a2bec83-ba6f-49e7-9499-fd4fe7fa2851 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2" status: 200 len: 1496 microversion: 2.1 time: 0.164327 Apr 14 03:12:41 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 225/679] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:12:41 2023] GET /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2 => generated 1496 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-630b5ab3-f9f3-4f45-9966-9f9ec38fe43f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-630b5ab3-f9f3-4f45-9966-9f9ec38fe43f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7f542934-641f-405f-811c-3601a3be389b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-630b5ab3-f9f3-4f45-9966-9f9ec38fe43f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-630b5ab3-f9f3-4f45-9966-9f9ec38fe43f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-630b5ab3-f9f3-4f45-9966-9f9ec38fe43f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-630b5ab3-f9f3-4f45-9966-9f9ec38fe43f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-630b5ab3-f9f3-4f45-9966-9f9ec38fe43f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-630b5ab3-f9f3-4f45-9966-9f9ec38fe43f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:42 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-630b5ab3-f9f3-4f45-9966-9f9ec38fe43f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:12:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-630b5ab3-f9f3-4f45-9966-9f9ec38fe43f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b" status: 200 len: 1442 microversion: 2.1 time: 0.204701 Apr 14 03:12:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 228/680] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:12:42 2023] GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b => generated 1442 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:12:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-4b1b295a-0b06-41e1-98a9-b8ba2e2d72b5 req-bd2b2045-4049-4348-b7a3-e04c850bd458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f542934-641f-405f-811c-3601a3be389b", "tag": "1ccf0327-517f-45c5-a995-1b3a7fcfdaf9"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:43 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=28 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:43 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=16 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4b1b295a-0b06-41e1-98a9-b8ba2e2d72b5 req-bd2b2045-4049-4348-b7a3-e04c850bd458 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4b1b295a-0b06-41e1-98a9-b8ba2e2d72b5 req-bd2b2045-4049-4348-b7a3-e04c850bd458 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4b1b295a-0b06-41e1-98a9-b8ba2e2d72b5 req-bd2b2045-4049-4348-b7a3-e04c850bd458 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-4b1b295a-0b06-41e1-98a9-b8ba2e2d72b5 req-bd2b2045-4049-4348-b7a3-e04c850bd458 service nova] Creating event network-changed:1ccf0327-517f-45c5-a995-1b3a7fcfdaf9 for instance 7f542934-641f-405f-811c-3601a3be389b on user Apr 14 03:12:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-4b1b295a-0b06-41e1-98a9-b8ba2e2d72b5 req-bd2b2045-4049-4348-b7a3-e04c850bd458 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037960 Apr 14 03:12:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 228/681] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:12:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:12:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b2468adf-83e3-4b85-90a6-e19852d396f6 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '.version_select at 0x7ff11a16a050>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b2468adf-83e3-4b85-90a6-e19852d396f6 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/images/b96871c7-2eee-43a3-82b5-3a0299fdd7a8" status: 200 len: 1724 microversion: 2.1 time: 0.052633 Apr 14 03:12:49 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 226/682] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 03:12:49 2023] GET /compute/v2.1/images/b96871c7-2eee-43a3-82b5-3a0299fdd7a8 => generated 1724 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 03:12:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-283683c1-cedd-4c5f-9bc9-dffe7a3a68f4 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '.version_select at 0x7ff11a3d95a0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-283683c1-cedd-4c5f-9bc9-dffe7a3a68f4 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/images/b96871c7-2eee-43a3-82b5-3a0299fdd7a8" status: 200 len: 1724 microversion: 2.1 time: 0.052483 Apr 14 03:12:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 229/683] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 03:12:49 2023] GET /compute/v2.1/images/b96871c7-2eee-43a3-82b5-3a0299fdd7a8 => generated 1724 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:12:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-da44a5fe-cb73-42d3-8224-2030aa8a7685 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-da44a5fe-cb73-42d3-8224-2030aa8a7685 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da44a5fe-cb73-42d3-8224-2030aa8a7685 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da44a5fe-cb73-42d3-8224-2030aa8a7685 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da44a5fe-cb73-42d3-8224-2030aa8a7685 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da44a5fe-cb73-42d3-8224-2030aa8a7685 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da44a5fe-cb73-42d3-8224-2030aa8a7685 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da44a5fe-cb73-42d3-8224-2030aa8a7685 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:50 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-da44a5fe-cb73-42d3-8224-2030aa8a7685 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c683fe5636b49858857033797ff8e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb4fbf55f04294a3d97800142bdca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:12:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-da44a5fe-cb73-42d3-8224-2030aa8a7685 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3" status: 200 len: 1673 microversion: 2.1 time: 0.535486 Apr 14 03:12:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 229/684] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:12:49 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3 => generated 1673 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1851758576", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-742486677", "security_groups": [{"name": "tempest-secgroup-smoke-1898708055"}], "block_device_mapping_v2": [{"uuid": "0ae128f0-64ab-4413-bae2-15cd90212c53", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ea0f3bca-5794-46e4-a270-53dbe99375bd"}]}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] validate_networks() for [('ea0f3bca-5794-46e4-a270-53dbe99375bd', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Getting quotas for user 60e11b7ab2914209b23bf7a53791da64 and project 2d2e49e8e92e416faebf55e3d4e0e087. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:12:51 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 5d0f51bd-b28d-4db1-be36-cec6cc92231e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ae128f0-64ab-4413-bae2-15cd90212c53',volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:12:51 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-425dbef7-e950-41a7-98ea-4facba282d02 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.836398 Apr 14 03:12:51 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 227/685] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:12:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:12:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f66a5401-068b-4126-971b-dc90a820a6e1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:12:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f66a5401-068b-4126-971b-dc90a820a6e1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 5d0f51bd-b28d-4db1-be36-cec6cc92231e] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:12:51 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-f66a5401-068b-4126-971b-dc90a820a6e1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:12:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f66a5401-068b-4126-971b-dc90a820a6e1 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e" status: 200 len: 1089 microversion: 2.1 time: 0.081779 Apr 14 03:12:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 230/686] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:12:51 2023] GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e => generated 1089 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:12:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-4519703a-f1b3-4c7d-98e6-f153d246dc06 req-d35c85af-2acb-4fa6-b086-76b42e2b2384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d0f51bd-b28d-4db1-be36-cec6cc92231e", "tag": "2885c06a-4dea-452f-a76a-e6a12bb525cc"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:12:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4519703a-f1b3-4c7d-98e6-f153d246dc06 req-d35c85af-2acb-4fa6-b086-76b42e2b2384 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:12:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4519703a-f1b3-4c7d-98e6-f153d246dc06 req-d35c85af-2acb-4fa6-b086-76b42e2b2384 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:12:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4519703a-f1b3-4c7d-98e6-f153d246dc06 req-d35c85af-2acb-4fa6-b086-76b42e2b2384 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:12:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-4519703a-f1b3-4c7d-98e6-f153d246dc06 req-d35c85af-2acb-4fa6-b086-76b42e2b2384 service nova] Creating event network-changed:2885c06a-4dea-452f-a76a-e6a12bb525cc for instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e on user Apr 14 03:12:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-4519703a-f1b3-4c7d-98e6-f153d246dc06 req-d35c85af-2acb-4fa6-b086-76b42e2b2384 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036682 Apr 14 03:12:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 230/687] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:12:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:01 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-13d6a822-2cea-437b-876b-a8f5c3e5fb35 req-ad123f65-1cc0-4d9d-8785-74dda117af9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f51bd-b28d-4db1-be36-cec6cc92231e", "name": "network-vif-plugged", "status": "completed", "tag": "2885c06a-4dea-452f-a76a-e6a12bb525cc"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-13d6a822-2cea-437b-876b-a8f5c3e5fb35 req-ad123f65-1cc0-4d9d-8785-74dda117af9f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-13d6a822-2cea-437b-876b-a8f5c3e5fb35 req-ad123f65-1cc0-4d9d-8785-74dda117af9f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-13d6a822-2cea-437b-876b-a8f5c3e5fb35 req-ad123f65-1cc0-4d9d-8785-74dda117af9f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-13d6a822-2cea-437b-876b-a8f5c3e5fb35 req-ad123f65-1cc0-4d9d-8785-74dda117af9f service nova] Creating event network-vif-plugged:2885c06a-4dea-452f-a76a-e6a12bb525cc for instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e on user Apr 14 03:13:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-13d6a822-2cea-437b-876b-a8f5c3e5fb35 req-ad123f65-1cc0-4d9d-8785-74dda117af9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036668 Apr 14 03:13:01 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 228/688] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-167127c9-ae26-4966-b521-1501b53b65f7 req-d4f22ed8-c7ef-409e-9af7-887dc0a05b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f51bd-b28d-4db1-be36-cec6cc92231e", "name": "network-vif-plugged", "status": "completed", "tag": "2885c06a-4dea-452f-a76a-e6a12bb525cc"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-167127c9-ae26-4966-b521-1501b53b65f7 req-d4f22ed8-c7ef-409e-9af7-887dc0a05b6b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-167127c9-ae26-4966-b521-1501b53b65f7 req-d4f22ed8-c7ef-409e-9af7-887dc0a05b6b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-167127c9-ae26-4966-b521-1501b53b65f7 req-d4f22ed8-c7ef-409e-9af7-887dc0a05b6b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-167127c9-ae26-4966-b521-1501b53b65f7 req-d4f22ed8-c7ef-409e-9af7-887dc0a05b6b service nova] Creating event network-vif-plugged:2885c06a-4dea-452f-a76a-e6a12bb525cc for instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e on user Apr 14 03:13:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-167127c9-ae26-4966-b521-1501b53b65f7 req-d4f22ed8-c7ef-409e-9af7-887dc0a05b6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044139 Apr 14 03:13:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 231/689] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b2fcfc41-ce99-4795-8161-0766c2dcfc27 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b2fcfc41-ce99-4795-8161-0766c2dcfc27 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2fcfc41-ce99-4795-8161-0766c2dcfc27 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2fcfc41-ce99-4795-8161-0766c2dcfc27 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2fcfc41-ce99-4795-8161-0766c2dcfc27 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2fcfc41-ce99-4795-8161-0766c2dcfc27 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2fcfc41-ce99-4795-8161-0766c2dcfc27 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2fcfc41-ce99-4795-8161-0766c2dcfc27 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b2fcfc41-ce99-4795-8161-0766c2dcfc27 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043970 Apr 14 03:13:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 231/690] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:13:04 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-8ed2ebff-beb6-4ac7-a1fe-51590515c420 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-8ed2ebff-beb6-4ac7-a1fe-51590515c420 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8ed2ebff-beb6-4ac7-a1fe-51590515c420 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8ed2ebff-beb6-4ac7-a1fe-51590515c420 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8ed2ebff-beb6-4ac7-a1fe-51590515c420 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8ed2ebff-beb6-4ac7-a1fe-51590515c420 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8ed2ebff-beb6-4ac7-a1fe-51590515c420 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8ed2ebff-beb6-4ac7-a1fe-51590515c420 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:04 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-8ed2ebff-beb6-4ac7-a1fe-51590515c420 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:13:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-8ed2ebff-beb6-4ac7-a1fe-51590515c420 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531" status: 204 len: 0 microversion: 2.1 time: 0.166934 Apr 14 03:13:04 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 229/691] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:13:04 2023] DELETE /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:13:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b7a7f5f7-9353-444f-82f4-4e98e0828b34 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:04 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b7a7f5f7-9353-444f-82f4-4e98e0828b34 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b7a7f5f7-9353-444f-82f4-4e98e0828b34 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b7a7f5f7-9353-444f-82f4-4e98e0828b34 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b7a7f5f7-9353-444f-82f4-4e98e0828b34 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b7a7f5f7-9353-444f-82f4-4e98e0828b34 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b7a7f5f7-9353-444f-82f4-4e98e0828b34 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b7a7f5f7-9353-444f-82f4-4e98e0828b34 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d3ebfbe4-afb0-4a74-ac93-9795371f3bcc req-3dbd7f70-3f92-41e3-9d99-b3647bb22bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-unplugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d3ebfbe4-afb0-4a74-ac93-9795371f3bcc req-3dbd7f70-3f92-41e3-9d99-b3647bb22bb9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d3ebfbe4-afb0-4a74-ac93-9795371f3bcc req-3dbd7f70-3f92-41e3-9d99-b3647bb22bb9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d3ebfbe4-afb0-4a74-ac93-9795371f3bcc req-3dbd7f70-3f92-41e3-9d99-b3647bb22bb9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d3ebfbe4-afb0-4a74-ac93-9795371f3bcc req-3dbd7f70-3f92-41e3-9d99-b3647bb22bb9 service nova] Creating event network-vif-unplugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:13:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d3ebfbe4-afb0-4a74-ac93-9795371f3bcc req-3dbd7f70-3f92-41e3-9d99-b3647bb22bb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.185693 Apr 14 03:13:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 232/692] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:05 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-b7a7f5f7-9353-444f-82f4-4e98e0828b34 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:13:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b7a7f5f7-9353-444f-82f4-4e98e0828b34 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531" status: 200 len: 1676 microversion: 2.1 time: 0.786154 Apr 14 03:13:05 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 232/693] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:13:04 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531 => generated 1676 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:13:06 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-b5450388-57e5-4402-9dbd-7d72f09ebebd req-1bcc59f1-c07e-460e-a127-fcb3777ae0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-deleted", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b5450388-57e5-4402-9dbd-7d72f09ebebd req-1bcc59f1-c07e-460e-a127-fcb3777ae0f7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b5450388-57e5-4402-9dbd-7d72f09ebebd req-1bcc59f1-c07e-460e-a127-fcb3777ae0f7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b5450388-57e5-4402-9dbd-7d72f09ebebd req-1bcc59f1-c07e-460e-a127-fcb3777ae0f7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:06 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-b5450388-57e5-4402-9dbd-7d72f09ebebd req-1bcc59f1-c07e-460e-a127-fcb3777ae0f7 service nova] Creating event network-vif-deleted:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:13:06 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-b5450388-57e5-4402-9dbd-7d72f09ebebd req-1bcc59f1-c07e-460e-a127-fcb3777ae0f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036215 Apr 14 03:13:06 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 230/694] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-861bb8b1-b639-4b69-a4fb-27b763fdb9a1 req-461d9cd6-0761-4128-aaa9-ea5bca61a600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47adee-bd94-4655-9bbd-ed59c5478531", "name": "network-vif-plugged", "status": "completed", "tag": "4773c5d2-1520-4fc1-ae46-f83a883cfd1b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-861bb8b1-b639-4b69-a4fb-27b763fdb9a1 req-461d9cd6-0761-4128-aaa9-ea5bca61a600 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-861bb8b1-b639-4b69-a4fb-27b763fdb9a1 req-461d9cd6-0761-4128-aaa9-ea5bca61a600 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-861bb8b1-b639-4b69-a4fb-27b763fdb9a1 req-461d9cd6-0761-4128-aaa9-ea5bca61a600 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-861bb8b1-b639-4b69-a4fb-27b763fdb9a1 req-461d9cd6-0761-4128-aaa9-ea5bca61a600 service nova] Creating event network-vif-plugged:4773c5d2-1520-4fc1-ae46-f83a883cfd1b for instance 4e47adee-bd94-4655-9bbd-ed59c5478531 on user Apr 14 03:13:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-861bb8b1-b639-4b69-a4fb-27b763fdb9a1 req-461d9cd6-0761-4128-aaa9-ea5bca61a600 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056073 Apr 14 03:13:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 233/695] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:07 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: 1840cf40-2228-4506-9a3f-0c9d29373533] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] HTTP exception thrown: Instance 1840cf40-2228-4506-9a3f-0c9d29373533 could not be found. Apr 14 03:13:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Request method failure captured: Apr 14 03:13:07 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533 HTTP/1.1 Apr 14 03:13:07 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:13:07 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:13:07 user devstack@n-api.service[61663]: Connection: close Apr 14 03:13:07 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:13:07 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:13:07 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:13:07 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:13:07 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMQerL5LRl2Pa0l_piZBZh1NGFRDPXiFK5SSFMLVFEyantTrAlUu0GuYWk9oGbJGM-L0KhweTo09YdinnqZxdjlUcJ-tmjr4ObAtQn9s-U8VDxwL_LHEmyMomVCTCeYgEHZZKetd9wfTjOMT9VsWfLIKpw8u2meGmydgKORA-nRP1gE Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Project-Id: 1318728a20064d49b9c1b2f89175a364 Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesActionsTest-121883605 Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1318728a20064d49b9c1b2f89175a364"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1318728a20064d49b9c1b2f89175a364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1318728a20064d49b9c1b2f89175a364"}]}] Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesActionsTest-121883605 Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Tenant-Id: 1318728a20064d49b9c1b2f89175a364 Apr 14 03:13:07 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesActionsTest-121883605 Apr 14 03:13:07 user devstack@n-api.service[61663]: X-User: tempest-VolumesActionsTest-121883605-project-member Apr 14 03:13:07 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:13:07 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:13:07 user devstack@n-api.service[61663]: X-User-Id: b2facbf385e8402c86706cc28d4707af Apr 14 03:13:07 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesActionsTest-121883605-project-member Apr 14 03:13:07 user devstack@n-api.service[61663]: method: > Apr 14 03:13:07 user devstack@n-api.service[61663]: exception: Instance 1840cf40-2228-4506-9a3f-0c9d29373533 could not be found. Apr 14 03:13:07 user devstack@n-api.service[61663]: action_args: {'id': '1840cf40-2228-4506-9a3f-0c9d29373533'} Apr 14 03:13:07 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1840cf40-2228-4506-9a3f-0c9d29373533 could not be found. Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1840cf40-2228-4506-9a3f-0c9d29373533 could not be found. Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1840cf40-2228-4506-9a3f-0c9d29373533 could not be found. Apr 14 03:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:13:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Returning 404 to user: Instance 1840cf40-2228-4506-9a3f-0c9d29373533 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:13:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ca975f8b-7de2-48dd-b8fd-3956df186751 tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533" status: 404 len: 111 microversion: 2.1 time: 0.041662 Apr 14 03:13:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 233/696] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:13:07 2023] GET /compute/v2.1/servers/1840cf40-2228-4506-9a3f-0c9d29373533 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:13:07 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2095269608", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "5c0957e8-ebf2-4e1b-82f8-370034962c6d"}]}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:07 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] validate_networks() for [('5c0957e8-ebf2-4e1b-82f8-370034962c6d', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Getting quotas for project 1318728a20064d49b9c1b2f89175a364. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Getting quotas for user b2facbf385e8402c86706cc28d4707af and project 1318728a20064d49b9c1b2f89175a364. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:13:08 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: d309dc50-d3b0-47a4-b263-a67ae96e2f5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:13:08 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-075d00e0-e8cf-47ab-aa72-d6b4f279392c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.667251 Apr 14 03:13:08 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 231/697] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:13:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:13:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-abde2530-7507-4b1b-8a32-d5aa19f0dc1e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:08 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-abde2530-7507-4b1b-8a32-d5aa19f0dc1e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: d309dc50-d3b0-47a4-b263-a67ae96e2f5b] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:08 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-abde2530-7507-4b1b-8a32-d5aa19f0dc1e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2facbf385e8402c86706cc28d4707af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318728a20064d49b9c1b2f89175a364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:13:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-abde2530-7507-4b1b-8a32-d5aa19f0dc1e tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b" status: 200 len: 1208 microversion: 2.1 time: 0.088667 Apr 14 03:13:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 234/698] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:13:08 2023] GET /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b => generated 1208 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:13:11 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-97408815-25c0-4647-9705-d48c6a9dba20 req-86325cd9-7c96-4128-b0a4-dfef961be204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d309dc50-d3b0-47a4-b263-a67ae96e2f5b", "tag": "2749fb25-d2ff-43bb-b58c-f1d7694570de"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-97408815-25c0-4647-9705-d48c6a9dba20 req-86325cd9-7c96-4128-b0a4-dfef961be204 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-97408815-25c0-4647-9705-d48c6a9dba20 req-86325cd9-7c96-4128-b0a4-dfef961be204 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-97408815-25c0-4647-9705-d48c6a9dba20 req-86325cd9-7c96-4128-b0a4-dfef961be204 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:11 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-97408815-25c0-4647-9705-d48c6a9dba20 req-86325cd9-7c96-4128-b0a4-dfef961be204 service nova] Creating event network-changed:2749fb25-d2ff-43bb-b58c-f1d7694570de for instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b on user Apr 14 03:13:11 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-97408815-25c0-4647-9705-d48c6a9dba20 req-86325cd9-7c96-4128-b0a4-dfef961be204 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036234 Apr 14 03:13:11 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 234/699] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:11 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-66eea045-a674-4272-8db6-1e6e4b4562b2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:11 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-66eea045-a674-4272-8db6-1e6e4b4562b2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 24d1359d-2dcd-46d7-90f3-3801df9be357] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:11 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-66eea045-a674-4272-8db6-1e6e4b4562b2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-66eea045-a674-4272-8db6-1e6e4b4562b2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-66eea045-a674-4272-8db6-1e6e4b4562b2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-66eea045-a674-4272-8db6-1e6e4b4562b2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-66eea045-a674-4272-8db6-1e6e4b4562b2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-66eea045-a674-4272-8db6-1e6e4b4562b2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:12 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-66eea045-a674-4272-8db6-1e6e4b4562b2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:13:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-66eea045-a674-4272-8db6-1e6e4b4562b2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357" status: 200 len: 1537 microversion: 2.1 time: 0.249242 Apr 14 03:13:12 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 232/700] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:13:11 2023] GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357 => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:13:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-34140f78-79b6-44ee-9fa9-b5f7d0ac91d8 req-9ef34414-e8f4-4696-b5a9-83bc8ea46eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d309dc50-d3b0-47a4-b263-a67ae96e2f5b", "name": "network-vif-plugged", "status": "completed", "tag": "2749fb25-d2ff-43bb-b58c-f1d7694570de"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-34140f78-79b6-44ee-9fa9-b5f7d0ac91d8 req-9ef34414-e8f4-4696-b5a9-83bc8ea46eb7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-34140f78-79b6-44ee-9fa9-b5f7d0ac91d8 req-9ef34414-e8f4-4696-b5a9-83bc8ea46eb7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-34140f78-79b6-44ee-9fa9-b5f7d0ac91d8 req-9ef34414-e8f4-4696-b5a9-83bc8ea46eb7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-34140f78-79b6-44ee-9fa9-b5f7d0ac91d8 req-9ef34414-e8f4-4696-b5a9-83bc8ea46eb7 service nova] Creating event network-vif-plugged:2749fb25-d2ff-43bb-b58c-f1d7694570de for instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b on user Apr 14 03:13:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-34140f78-79b6-44ee-9fa9-b5f7d0ac91d8 req-9ef34414-e8f4-4696-b5a9-83bc8ea46eb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163362 Apr 14 03:13:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 235/701] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-59ebda58-1f07-4858-9cb0-083110be1475 req-b01b7ed0-497d-401b-9180-39ee44e6d2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d309dc50-d3b0-47a4-b263-a67ae96e2f5b", "name": "network-vif-plugged", "status": "completed", "tag": "2749fb25-d2ff-43bb-b58c-f1d7694570de"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-59ebda58-1f07-4858-9cb0-083110be1475 req-b01b7ed0-497d-401b-9180-39ee44e6d2c7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-59ebda58-1f07-4858-9cb0-083110be1475 req-b01b7ed0-497d-401b-9180-39ee44e6d2c7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-59ebda58-1f07-4858-9cb0-083110be1475 req-b01b7ed0-497d-401b-9180-39ee44e6d2c7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-59ebda58-1f07-4858-9cb0-083110be1475 req-b01b7ed0-497d-401b-9180-39ee44e6d2c7 service nova] Creating event network-vif-plugged:2749fb25-d2ff-43bb-b58c-f1d7694570de for instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b on user Apr 14 03:13:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-59ebda58-1f07-4858-9cb0-083110be1475 req-b01b7ed0-497d-401b-9180-39ee44e6d2c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031695 Apr 14 03:13:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 235/702] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:30 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-289155264", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "de8764bb-1ca4-4c30-8dee-bce850658327"}]}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:30 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] validate_networks() for [('de8764bb-1ca4-4c30-8dee-bce850658327', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Getting quotas for project bd2c5b2aafaf4ca7bf62e988ac726658. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Getting quotas for user d666936eb0ee43a2ad9e17a12e6e273d and project bd2c5b2aafaf4ca7bf62e988ac726658. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:13:31 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: bd5b587d-58a9-411b-a755-67adaa6bd6c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:13:31 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-21da6087-3618-494b-855c-bf9621f32d9b tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.627755 Apr 14 03:13:31 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 233/703] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 03:13:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 03:13:31 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:31 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=18 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:31 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=22 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-04f4c8ba-682f-429e-8ca4-b8caf6983666 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:31 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-04f4c8ba-682f-429e-8ca4-b8caf6983666 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: bd5b587d-58a9-411b-a755-67adaa6bd6c9] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:31 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-04f4c8ba-682f-429e-8ca4-b8caf6983666 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:13:31 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-04f4c8ba-682f-429e-8ca4-b8caf6983666 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:13:31 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-04f4c8ba-682f-429e-8ca4-b8caf6983666 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:13:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-04f4c8ba-682f-429e-8ca4-b8caf6983666 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9" status: 200 len: 1394 microversion: 2.87 time: 0.427574 Apr 14 03:13:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 236/704] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:13:31 2023] GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9 => generated 1394 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:13:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=14 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-9e810eb6-7124-4747-a85b-133dac0cd960 req-34f08e81-418a-41e0-b004-72933fdca25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5b587d-58a9-411b-a755-67adaa6bd6c9", "tag": "52fd899f-496c-41d3-a9e0-6574a27e3b1b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9e810eb6-7124-4747-a85b-133dac0cd960 req-34f08e81-418a-41e0-b004-72933fdca25e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9e810eb6-7124-4747-a85b-133dac0cd960 req-34f08e81-418a-41e0-b004-72933fdca25e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9e810eb6-7124-4747-a85b-133dac0cd960 req-34f08e81-418a-41e0-b004-72933fdca25e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-9e810eb6-7124-4747-a85b-133dac0cd960 req-34f08e81-418a-41e0-b004-72933fdca25e service nova] Creating event network-changed:52fd899f-496c-41d3-a9e0-6574a27e3b1b for instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 on user Apr 14 03:13:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-9e810eb6-7124-4747-a85b-133dac0cd960 req-34f08e81-418a-41e0-b004-72933fdca25e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045569 Apr 14 03:13:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 236/705] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-a4f8657a-ab2e-47d1-8636-a65517a84477 req-b87553f5-6237-4c87-84f4-0dd8034c7b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5b587d-58a9-411b-a755-67adaa6bd6c9", "name": "network-vif-plugged", "status": "completed", "tag": "52fd899f-496c-41d3-a9e0-6574a27e3b1b"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a4f8657a-ab2e-47d1-8636-a65517a84477 req-b87553f5-6237-4c87-84f4-0dd8034c7b47 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a4f8657a-ab2e-47d1-8636-a65517a84477 req-b87553f5-6237-4c87-84f4-0dd8034c7b47 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a4f8657a-ab2e-47d1-8636-a65517a84477 req-b87553f5-6237-4c87-84f4-0dd8034c7b47 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-a4f8657a-ab2e-47d1-8636-a65517a84477 req-b87553f5-6237-4c87-84f4-0dd8034c7b47 service nova] Creating event network-vif-plugged:52fd899f-496c-41d3-a9e0-6574a27e3b1b for instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 on user Apr 14 03:13:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-a4f8657a-ab2e-47d1-8636-a65517a84477 req-b87553f5-6237-4c87-84f4-0dd8034c7b47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180046 Apr 14 03:13:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 234/706] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-285eccf6-9fa1-443d-acf6-536d7179678a tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Action: 'create', calling method: .version_select at 0x7ff11a3ddc60>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1339724753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ITzOqj8xEk6dTBZ8Ot32M8Esvy3C6MqRifOQoX4ksa7bmDWj6LGvCYEbIDUI0lXUxkiCpG51Z30GVyclYEqcHtnzy83lAYeIu0VXyXlLqttu//3qnh/G2175vPwLjXQ=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:38 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-285eccf6-9fa1-443d-acf6-536d7179678a tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Getting quotas for project 0096d0892acf4d5f8a0fa290a18b451a. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:13:38 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-285eccf6-9fa1-443d-acf6-536d7179678a tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Getting quotas for user ba8614e27c65428d92e4bf01969976e7 and project 0096d0892acf4d5f8a0fa290a18b451a. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:13:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-285eccf6-9fa1-443d-acf6-536d7179678a tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.140850 Apr 14 03:13:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 237/707] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:13:38 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-9c1c6452-73d2-49f6-ac41-9ea9fd8c6ee9 req-d3391f2f-11ff-4892-ac90-a7082e50bbea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5b587d-58a9-411b-a755-67adaa6bd6c9", "name": "network-vif-plugged", "status": "completed", "tag": "52fd899f-496c-41d3-a9e0-6574a27e3b1b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9c1c6452-73d2-49f6-ac41-9ea9fd8c6ee9 req-d3391f2f-11ff-4892-ac90-a7082e50bbea service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9c1c6452-73d2-49f6-ac41-9ea9fd8c6ee9 req-d3391f2f-11ff-4892-ac90-a7082e50bbea service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9c1c6452-73d2-49f6-ac41-9ea9fd8c6ee9 req-d3391f2f-11ff-4892-ac90-a7082e50bbea service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-9c1c6452-73d2-49f6-ac41-9ea9fd8c6ee9 req-d3391f2f-11ff-4892-ac90-a7082e50bbea service nova] Creating event network-vif-plugged:52fd899f-496c-41d3-a9e0-6574a27e3b1b for instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 on user Apr 14 03:13:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-9c1c6452-73d2-49f6-ac41-9ea9fd8c6ee9 req-d3391f2f-11ff-4892-ac90-a7082e50bbea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038815 Apr 14 03:13:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 237/708] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:39 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-79587855", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1339724753", "security_groups": [{"name": "tempest-secgroup-smoke-1446928025"}], "networks": [{"uuid": "f30776a2-73d7-4689-8046-ab07cd500f82"}]}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:39 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] validate_networks() for [('f30776a2-73d7-4689-8046-ab07cd500f82', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Getting quotas for project 0096d0892acf4d5f8a0fa290a18b451a. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Getting quotas for user ba8614e27c65428d92e4bf01969976e7 and project 0096d0892acf4d5f8a0fa290a18b451a. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:13:40 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:13:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-fbe18a6f-9a78-47ad-bf07-eb632b12d300 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.584801 Apr 14 03:13:40 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 235/709] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:13:39 2023] POST /compute/v2.1/servers => generated 404 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:13:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b6437470-b823-48b7-a2c3-84caa9e88d7f tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:40 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b6437470-b823-48b7-a2c3-84caa9e88d7f tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:40 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b6437470-b823-48b7-a2c3-84caa9e88d7f tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8614e27c65428d92e4bf01969976e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0096d0892acf4d5f8a0fa290a18b451a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:13:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b6437470-b823-48b7-a2c3-84caa9e88d7f tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4" status: 200 len: 1255 microversion: 2.1 time: 0.080872 Apr 14 03:13:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 238/710] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:13:40 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 => generated 1255 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:13:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e7ead739-5a9a-4e01-ae56-98a99efbb448 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb69c0bd-af4f-438c-b96a-94c59261813a", "device": "/dev/vdb"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:41 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e7ead739-5a9a-4e01-ae56-98a99efbb448 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: 0708e26d-9d20-4cb0-9b8c-76249f74f0a2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7ead739-5a9a-4e01-ae56-98a99efbb448 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7ead739-5a9a-4e01-ae56-98a99efbb448 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7ead739-5a9a-4e01-ae56-98a99efbb448 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7ead739-5a9a-4e01-ae56-98a99efbb448 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7ead739-5a9a-4e01-ae56-98a99efbb448 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7ead739-5a9a-4e01-ae56-98a99efbb448 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e7ead739-5a9a-4e01-ae56-98a99efbb448 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501963 Apr 14 03:13:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 238/711] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:13:41 2023] POST /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:42 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-936be048-569c-4781-a8c8-d8cb837edc0e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:42 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-936be048-569c-4781-a8c8-d8cb837edc0e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 5d0f51bd-b28d-4db1-be36-cec6cc92231e] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-936be048-569c-4781-a8c8-d8cb837edc0e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-936be048-569c-4781-a8c8-d8cb837edc0e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-936be048-569c-4781-a8c8-d8cb837edc0e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-936be048-569c-4781-a8c8-d8cb837edc0e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-936be048-569c-4781-a8c8-d8cb837edc0e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-936be048-569c-4781-a8c8-d8cb837edc0e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:42 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-936be048-569c-4781-a8c8-d8cb837edc0e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:13:42 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-936be048-569c-4781-a8c8-d8cb837edc0e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e" status: 200 len: 1442 microversion: 2.1 time: 0.271708 Apr 14 03:13:42 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 236/712] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:13:42 2023] GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e => generated 1442 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:13:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-08135dc2-7657-4c23-b082-a9ad9be9230c req-f6f62170-8ecd-45cd-8835-b0a783c61469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4", "tag": "73d42070-416a-497f-b3d4-8467d8255c5f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-08135dc2-7657-4c23-b082-a9ad9be9230c req-f6f62170-8ecd-45cd-8835-b0a783c61469 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-08135dc2-7657-4c23-b082-a9ad9be9230c req-f6f62170-8ecd-45cd-8835-b0a783c61469 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-08135dc2-7657-4c23-b082-a9ad9be9230c req-f6f62170-8ecd-45cd-8835-b0a783c61469 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-08135dc2-7657-4c23-b082-a9ad9be9230c req-f6f62170-8ecd-45cd-8835-b0a783c61469 service nova] Creating event network-changed:73d42070-416a-497f-b3d4-8467d8255c5f for instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 on user Apr 14 03:13:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-08135dc2-7657-4c23-b082-a9ad9be9230c req-f6f62170-8ecd-45cd-8835-b0a783c61469 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084071 Apr 14 03:13:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 239/713] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-cb3e9f21-3785-41f7-ba41-576b660839a7 req-84b3fc97-315a-48af-bb2f-570999d3caa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4", "name": "network-vif-plugged", "status": "completed", "tag": "73d42070-416a-497f-b3d4-8467d8255c5f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cb3e9f21-3785-41f7-ba41-576b660839a7 req-84b3fc97-315a-48af-bb2f-570999d3caa7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cb3e9f21-3785-41f7-ba41-576b660839a7 req-84b3fc97-315a-48af-bb2f-570999d3caa7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cb3e9f21-3785-41f7-ba41-576b660839a7 req-84b3fc97-315a-48af-bb2f-570999d3caa7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-cb3e9f21-3785-41f7-ba41-576b660839a7 req-84b3fc97-315a-48af-bb2f-570999d3caa7 service nova] Creating event network-vif-plugged:73d42070-416a-497f-b3d4-8467d8255c5f for instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 on user Apr 14 03:13:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-cb3e9f21-3785-41f7-ba41-576b660839a7 req-84b3fc97-315a-48af-bb2f-570999d3caa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036530 Apr 14 03:13:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 239/714] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:47 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-eeeeebdf-a984-4f01-bd39-df8402c21c0d req-6f0676b9-520e-4f04-b4dc-0271009b83df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4", "name": "network-vif-plugged", "status": "completed", "tag": "73d42070-416a-497f-b3d4-8467d8255c5f"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-eeeeebdf-a984-4f01-bd39-df8402c21c0d req-6f0676b9-520e-4f04-b4dc-0271009b83df service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-eeeeebdf-a984-4f01-bd39-df8402c21c0d req-6f0676b9-520e-4f04-b4dc-0271009b83df service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-eeeeebdf-a984-4f01-bd39-df8402c21c0d req-6f0676b9-520e-4f04-b4dc-0271009b83df service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:47 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-eeeeebdf-a984-4f01-bd39-df8402c21c0d req-6f0676b9-520e-4f04-b4dc-0271009b83df service nova] Creating event network-vif-plugged:73d42070-416a-497f-b3d4-8467d8255c5f for instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 on user Apr 14 03:13:47 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-eeeeebdf-a984-4f01-bd39-df8402c21c0d req-6f0676b9-520e-4f04-b4dc-0271009b83df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040401 Apr 14 03:13:47 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 237/715] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:13:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:50 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1a7608fc-f200-4d79-9779-d2dc435e7e2e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1a7608fc-f200-4d79-9779-d2dc435e7e2e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a7608fc-f200-4d79-9779-d2dc435e7e2e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a7608fc-f200-4d79-9779-d2dc435e7e2e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a7608fc-f200-4d79-9779-d2dc435e7e2e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a7608fc-f200-4d79-9779-d2dc435e7e2e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a7608fc-f200-4d79-9779-d2dc435e7e2e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1a7608fc-f200-4d79-9779-d2dc435e7e2e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:50 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-1a7608fc-f200-4d79-9779-d2dc435e7e2e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c683fe5636b49858857033797ff8e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb4fbf55f04294a3d97800142bdca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:13:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1a7608fc-f200-4d79-9779-d2dc435e7e2e tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3" status: 200 len: 1673 microversion: 2.1 time: 0.170734 Apr 14 03:13:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 240/716] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:13:50 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:13:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fff5d89-4516-4be1-9698-f088498889ff"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:13:53 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328781 Apr 14 03:13:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 240/717] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:13:53 2023] POST /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 4e47adee-bd94-4655-9bbd-ed59c5478531] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=12 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] HTTP exception thrown: Instance 4e47adee-bd94-4655-9bbd-ed59c5478531 could not be found. Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Request method failure captured: Apr 14 03:13:55 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531 HTTP/1.1 Apr 14 03:13:55 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:13:55 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:13:55 user devstack@n-api.service[61662]: Connection: close Apr 14 03:13:55 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:13:55 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:13:55 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:13:55 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:13:55 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEwmVtNRDetgWO5mTD1bEUocoJOj9YFGH40WwivXpN1Xs8gxlA0vVPe_uVHwCMswvqd9NviH5dTXLGC0t38Yu4iQwgvLzajFOxfBIuObMRSmhp1Wer7zSPZ6VE5STLyrn3LfTG0y7nuum9vJ4mym9BmUd-cBbpnhMSg3gviUoA8AKw Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Project-Id: 558bfd7e1d9049d396381de148b0c4a5 Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/558bfd7e1d9049d396381de148b0c4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/558bfd7e1d9049d396381de148b0c4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/558bfd7e1d9049d396381de148b0c4a5"}]}] Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Tenant: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Tenant-Id: 558bfd7e1d9049d396381de148b0c4a5 Apr 14 03:13:55 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:13:55 user devstack@n-api.service[61662]: X-User: tempest-ServerRescueNegativeTestJSON-773851452-project-member Apr 14 03:13:55 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:13:55 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:13:55 user devstack@n-api.service[61662]: X-User-Id: d5e8150f1502427fb3148f20354d212e Apr 14 03:13:55 user devstack@n-api.service[61662]: X-User-Name: tempest-ServerRescueNegativeTestJSON-773851452-project-member Apr 14 03:13:55 user devstack@n-api.service[61662]: method: > Apr 14 03:13:55 user devstack@n-api.service[61662]: exception: Instance 4e47adee-bd94-4655-9bbd-ed59c5478531 could not be found. Apr 14 03:13:55 user devstack@n-api.service[61662]: action_args: {'id': '4e47adee-bd94-4655-9bbd-ed59c5478531'} Apr 14 03:13:55 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e47adee-bd94-4655-9bbd-ed59c5478531 could not be found. Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e47adee-bd94-4655-9bbd-ed59c5478531 could not be found. Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e47adee-bd94-4655-9bbd-ed59c5478531 could not be found. Apr 14 03:13:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:13:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Returning 404 to user: Instance 4e47adee-bd94-4655-9bbd-ed59c5478531 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:13:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-5497dc37-9d26-444b-beaf-7d15910b966f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531" status: 404 len: 111 microversion: 2.1 time: 0.032012 Apr 14 03:13:55 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 238/718] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:13:55 2023] GET /compute/v2.1/servers/4e47adee-bd94-4655-9bbd-ed59c5478531 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:13:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a4317a8c-84ab-4bac-9b85-27de2af3fb01 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '.version_select at 0x7ff11a3dd090>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a4317a8c-84ab-4bac-9b85-27de2af3fb01 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-158606901" status: 202 len: 0 microversion: 2.1 time: 0.025627 Apr 14 03:13:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 241/719] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 03:13:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-158606901 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:13:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f91f67fe-9b78-43d0-a3d8-463ab6423baa tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:13:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f91f67fe-9b78-43d0-a3d8-463ab6423baa tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: d309dc50-d3b0-47a4-b263-a67ae96e2f5b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:13:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f91f67fe-9b78-43d0-a3d8-463ab6423baa tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f91f67fe-9b78-43d0-a3d8-463ab6423baa tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f91f67fe-9b78-43d0-a3d8-463ab6423baa tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f91f67fe-9b78-43d0-a3d8-463ab6423baa tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:13:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f91f67fe-9b78-43d0-a3d8-463ab6423baa tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:13:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f91f67fe-9b78-43d0-a3d8-463ab6423baa tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:13:58 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-f91f67fe-9b78-43d0-a3d8-463ab6423baa tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2facbf385e8402c86706cc28d4707af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318728a20064d49b9c1b2f89175a364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:13:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f91f67fe-9b78-43d0-a3d8-463ab6423baa tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b" status: 200 len: 1486 microversion: 2.1 time: 0.198463 Apr 14 03:13:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 241/720] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:13:58 2023] GET /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b => generated 1486 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b5decce8-13fc-41bb-abf5-db5abdd9baea tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "b96871c7-2eee-43a3-82b5-3a0299fdd7a8"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-b5decce8-13fc-41bb-abf5-db5abdd9baea tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b5decce8-13fc-41bb-abf5-db5abdd9baea tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b5decce8-13fc-41bb-abf5-db5abdd9baea tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b5decce8-13fc-41bb-abf5-db5abdd9baea tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b5decce8-13fc-41bb-abf5-db5abdd9baea tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b5decce8-13fc-41bb-abf5-db5abdd9baea tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b5decce8-13fc-41bb-abf5-db5abdd9baea tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=17 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:01 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-b5decce8-13fc-41bb-abf5-db5abdd9baea tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lazy-loading 'flavor' on Instance uuid 8a67985b-1938-4b7d-b486-13f6811611f3 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:14:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b5decce8-13fc-41bb-abf5-db5abdd9baea tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/action" status: 200 len: 29 microversion: 2.1 time: 0.241864 Apr 14 03:14:01 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 239/721] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:14:01 2023] POST /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/action => generated 29 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8af08d92-a39f-446e-b433-1b1f381bbcbe tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8af08d92-a39f-446e-b433-1b1f381bbcbe tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af08d92-a39f-446e-b433-1b1f381bbcbe tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af08d92-a39f-446e-b433-1b1f381bbcbe tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af08d92-a39f-446e-b433-1b1f381bbcbe tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af08d92-a39f-446e-b433-1b1f381bbcbe tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af08d92-a39f-446e-b433-1b1f381bbcbe tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8af08d92-a39f-446e-b433-1b1f381bbcbe tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:01 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-8af08d92-a39f-446e-b433-1b1f381bbcbe tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c683fe5636b49858857033797ff8e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb4fbf55f04294a3d97800142bdca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8af08d92-a39f-446e-b433-1b1f381bbcbe tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3" status: 200 len: 1725 microversion: 2.1 time: 0.195873 Apr 14 03:14:01 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 242/722] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:01 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-e192af85-fe42-4a18-ae5f-9a4d69bf13c0 req-600d6c06-9cba-4e1e-ae76-2a16a6879147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-unplugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e192af85-fe42-4a18-ae5f-9a4d69bf13c0 req-600d6c06-9cba-4e1e-ae76-2a16a6879147 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e192af85-fe42-4a18-ae5f-9a4d69bf13c0 req-600d6c06-9cba-4e1e-ae76-2a16a6879147 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e192af85-fe42-4a18-ae5f-9a4d69bf13c0 req-600d6c06-9cba-4e1e-ae76-2a16a6879147 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e192af85-fe42-4a18-ae5f-9a4d69bf13c0 req-600d6c06-9cba-4e1e-ae76-2a16a6879147 service nova] Creating event network-vif-unplugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:14:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-e192af85-fe42-4a18-ae5f-9a4d69bf13c0 req-600d6c06-9cba-4e1e-ae76-2a16a6879147 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036152 Apr 14 03:14:02 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 242/723] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:02 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d5bc8fca-df5d-4014-bd76-e7e6fd9b594c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:02 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d5bc8fca-df5d-4014-bd76-e7e6fd9b594c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: ac032176-63bc-457c-ad53-5b4a854eec34] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d5bc8fca-df5d-4014-bd76-e7e6fd9b594c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d5bc8fca-df5d-4014-bd76-e7e6fd9b594c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d5bc8fca-df5d-4014-bd76-e7e6fd9b594c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d5bc8fca-df5d-4014-bd76-e7e6fd9b594c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d5bc8fca-df5d-4014-bd76-e7e6fd9b594c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d5bc8fca-df5d-4014-bd76-e7e6fd9b594c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:02 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d5bc8fca-df5d-4014-bd76-e7e6fd9b594c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: ac032176-63bc-457c-ad53-5b4a854eec34] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:14:02 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d5bc8fca-df5d-4014-bd76-e7e6fd9b594c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34" status: 204 len: 0 microversion: 2.1 time: 0.142831 Apr 14 03:14:02 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 240/724] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:14:02 2023] DELETE /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:14:02 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e43f4191-6078-4d8b-bc81-9053de1d9286 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:02 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e43f4191-6078-4d8b-bc81-9053de1d9286 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: ac032176-63bc-457c-ad53-5b4a854eec34] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e43f4191-6078-4d8b-bc81-9053de1d9286 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e43f4191-6078-4d8b-bc81-9053de1d9286 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e43f4191-6078-4d8b-bc81-9053de1d9286 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e43f4191-6078-4d8b-bc81-9053de1d9286 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e43f4191-6078-4d8b-bc81-9053de1d9286 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e43f4191-6078-4d8b-bc81-9053de1d9286 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:03 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-e43f4191-6078-4d8b-bc81-9053de1d9286 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e43f4191-6078-4d8b-bc81-9053de1d9286 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34" status: 200 len: 1495 microversion: 2.1 time: 0.358665 Apr 14 03:14:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 243/725] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:02 2023] GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34 => generated 1495 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-248e3821-da12-4792-8662-f6d5fd95ae0a req-719c32d4-000a-4553-a445-e5885642d472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}, {"server_uuid": "ac032176-63bc-457c-ad53-5b4a854eec34", "name": "network-vif-unplugged", "status": "completed", "tag": "59fef74f-8c76-4dd5-bc99-311eea495950"}, {"server_uuid": "ac032176-63bc-457c-ad53-5b4a854eec34", "name": "network-vif-plugged", "status": "completed", "tag": "59fef74f-8c76-4dd5-bc99-311eea495950"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-248e3821-da12-4792-8662-f6d5fd95ae0a req-719c32d4-000a-4553-a445-e5885642d472 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-248e3821-da12-4792-8662-f6d5fd95ae0a req-719c32d4-000a-4553-a445-e5885642d472 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-248e3821-da12-4792-8662-f6d5fd95ae0a req-719c32d4-000a-4553-a445-e5885642d472 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-248e3821-da12-4792-8662-f6d5fd95ae0a req-719c32d4-000a-4553-a445-e5885642d472 service nova] Creating event network-vif-plugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:14:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-248e3821-da12-4792-8662-f6d5fd95ae0a req-719c32d4-000a-4553-a445-e5885642d472 service nova] Creating event network-vif-unplugged:59fef74f-8c76-4dd5-bc99-311eea495950 for instance ac032176-63bc-457c-ad53-5b4a854eec34 on user Apr 14 03:14:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-248e3821-da12-4792-8662-f6d5fd95ae0a req-719c32d4-000a-4553-a445-e5885642d472 service nova] Creating event network-vif-plugged:59fef74f-8c76-4dd5-bc99-311eea495950 for instance ac032176-63bc-457c-ad53-5b4a854eec34 on user Apr 14 03:14:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-248e3821-da12-4792-8662-f6d5fd95ae0a req-719c32d4-000a-4553-a445-e5885642d472 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.054705 Apr 14 03:14:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 243/726] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:04 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a18ebcfa-8927-4fde-9710-abe0a21f955f tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:04 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-a18ebcfa-8927-4fde-9710-abe0a21f955f tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: 0708e26d-9d20-4cb0-9b8c-76249f74f0a2] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a18ebcfa-8927-4fde-9710-abe0a21f955f tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a18ebcfa-8927-4fde-9710-abe0a21f955f tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a18ebcfa-8927-4fde-9710-abe0a21f955f tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a18ebcfa-8927-4fde-9710-abe0a21f955f tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a18ebcfa-8927-4fde-9710-abe0a21f955f tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a18ebcfa-8927-4fde-9710-abe0a21f955f tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:04 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-a18ebcfa-8927-4fde-9710-abe0a21f955f tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lazy-loading 'services' on Instance uuid 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:14:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a18ebcfa-8927-4fde-9710-abe0a21f955f tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2/os-volume_attachments/eb69c0bd-af4f-438c-b96a-94c59261813a" status: 202 len: 0 microversion: 2.1 time: 0.179323 Apr 14 03:14:04 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 241/727] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:14:04 2023] DELETE /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2/os-volume_attachments/eb69c0bd-af4f-438c-b96a-94c59261813a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:14:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-cf912c97-3ad4-4b21-b283-539752caa9cf tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:04 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-cf912c97-3ad4-4b21-b283-539752caa9cf tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: 0708e26d-9d20-4cb0-9b8c-76249f74f0a2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf912c97-3ad4-4b21-b283-539752caa9cf tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf912c97-3ad4-4b21-b283-539752caa9cf tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf912c97-3ad4-4b21-b283-539752caa9cf tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf912c97-3ad4-4b21-b283-539752caa9cf tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf912c97-3ad4-4b21-b283-539752caa9cf tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-cf912c97-3ad4-4b21-b283-539752caa9cf tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:04 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-cf912c97-3ad4-4b21-b283-539752caa9cf tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: 0708e26d-9d20-4cb0-9b8c-76249f74f0a2] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:14:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-cf912c97-3ad4-4b21-b283-539752caa9cf tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2" status: 204 len: 0 microversion: 2.1 time: 0.162056 Apr 14 03:14:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 244/728] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:14:04 2023] DELETE /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1c710b34-fa3d-421f-9b97-7d0d19730ae0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1c710b34-fa3d-421f-9b97-7d0d19730ae0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: 0708e26d-9d20-4cb0-9b8c-76249f74f0a2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=17 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c710b34-fa3d-421f-9b97-7d0d19730ae0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c710b34-fa3d-421f-9b97-7d0d19730ae0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c710b34-fa3d-421f-9b97-7d0d19730ae0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c710b34-fa3d-421f-9b97-7d0d19730ae0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c710b34-fa3d-421f-9b97-7d0d19730ae0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c710b34-fa3d-421f-9b97-7d0d19730ae0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:05 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-1c710b34-fa3d-421f-9b97-7d0d19730ae0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0128a733bd6a4120addba5eda1cc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4549f6080dcf4c739ac03ef643801fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1c710b34-fa3d-421f-9b97-7d0d19730ae0 tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2" status: 200 len: 1548 microversion: 2.1 time: 0.298566 Apr 14 03:14:05 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 244/729] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:05 2023] GET /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2 => generated 1548 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:06 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-a044ccf7-3bfd-4d93-9bcc-218af9cf3089 req-868dda2f-ae86-45b5-9fbc-de01b9c69b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac032176-63bc-457c-ad53-5b4a854eec34", "name": "network-vif-deleted", "tag": "59fef74f-8c76-4dd5-bc99-311eea495950"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a044ccf7-3bfd-4d93-9bcc-218af9cf3089 req-868dda2f-ae86-45b5-9fbc-de01b9c69b47 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a044ccf7-3bfd-4d93-9bcc-218af9cf3089 req-868dda2f-ae86-45b5-9fbc-de01b9c69b47 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:06 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-a044ccf7-3bfd-4d93-9bcc-218af9cf3089 req-868dda2f-ae86-45b5-9fbc-de01b9c69b47 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:06 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-a044ccf7-3bfd-4d93-9bcc-218af9cf3089 req-868dda2f-ae86-45b5-9fbc-de01b9c69b47 service nova] Creating event network-vif-deleted:59fef74f-8c76-4dd5-bc99-311eea495950 for instance ac032176-63bc-457c-ad53-5b4a854eec34 on user Apr 14 03:14:06 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-a044ccf7-3bfd-4d93-9bcc-218af9cf3089 req-868dda2f-ae86-45b5-9fbc-de01b9c69b47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028608 Apr 14 03:14:06 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 242/730] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-ae128952-ef68-44de-93fc-7fea6cbbdbc5 req-93601d27-7021-4877-b002-8ee2ebbc5ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0708e26d-9d20-4cb0-9b8c-76249f74f0a2", "name": "network-vif-unplugged", "status": "completed", "tag": "6f05389c-b6d4-40ce-afa3-06e781a35ba5"}, {"server_uuid": "0708e26d-9d20-4cb0-9b8c-76249f74f0a2", "name": "network-vif-plugged", "status": "completed", "tag": "6f05389c-b6d4-40ce-afa3-06e781a35ba5"}, {"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}, {"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}, {"server_uuid": "0708e26d-9d20-4cb0-9b8c-76249f74f0a2", "name": "network-vif-deleted", "tag": "6f05389c-b6d4-40ce-afa3-06e781a35ba5"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ae128952-ef68-44de-93fc-7fea6cbbdbc5 req-93601d27-7021-4877-b002-8ee2ebbc5ff5 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ae128952-ef68-44de-93fc-7fea6cbbdbc5 req-93601d27-7021-4877-b002-8ee2ebbc5ff5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ae128952-ef68-44de-93fc-7fea6cbbdbc5 req-93601d27-7021-4877-b002-8ee2ebbc5ff5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-ae128952-ef68-44de-93fc-7fea6cbbdbc5 req-93601d27-7021-4877-b002-8ee2ebbc5ff5 service nova] Creating event network-vif-unplugged:6f05389c-b6d4-40ce-afa3-06e781a35ba5 for instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 on user Apr 14 03:14:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-ae128952-ef68-44de-93fc-7fea6cbbdbc5 req-93601d27-7021-4877-b002-8ee2ebbc5ff5 service nova] Creating event network-vif-plugged:6f05389c-b6d4-40ce-afa3-06e781a35ba5 for instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 on user Apr 14 03:14:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-ae128952-ef68-44de-93fc-7fea6cbbdbc5 req-93601d27-7021-4877-b002-8ee2ebbc5ff5 service nova] Creating event network-vif-plugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:14:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-ae128952-ef68-44de-93fc-7fea6cbbdbc5 req-93601d27-7021-4877-b002-8ee2ebbc5ff5 service nova] Creating event network-vif-plugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:14:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-ae128952-ef68-44de-93fc-7fea6cbbdbc5 req-93601d27-7021-4877-b002-8ee2ebbc5ff5 service nova] Creating event network-vif-deleted:6f05389c-b6d4-40ce-afa3-06e781a35ba5 for instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 on user Apr 14 03:14:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-ae128952-ef68-44de-93fc-7fea6cbbdbc5 req-93601d27-7021-4877-b002-8ee2ebbc5ff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.049463 Apr 14 03:14:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 245/731] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:08 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e7bf471a-3050-441c-afa5-17b467eaa2cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:12 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e7bf471a-3050-441c-afa5-17b467eaa2cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 24d1359d-2dcd-46d7-90f3-3801df9be357] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7bf471a-3050-441c-afa5-17b467eaa2cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7bf471a-3050-441c-afa5-17b467eaa2cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7bf471a-3050-441c-afa5-17b467eaa2cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7bf471a-3050-441c-afa5-17b467eaa2cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7bf471a-3050-441c-afa5-17b467eaa2cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e7bf471a-3050-441c-afa5-17b467eaa2cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e7bf471a-3050-441c-afa5-17b467eaa2cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.206085 Apr 14 03:14:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 245/732] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:14:12 2023] GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357/os-interface => generated 282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-558f5972-ed03-4aa3-ba59-83b243971596 req-4b002fdc-1f62-4929-ad20-6e1fe7129a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d1359d-2dcd-46d7-90f3-3801df9be357", "tag": "6ea4c00e-5d4b-4375-9b8d-60177a6ec526"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-558f5972-ed03-4aa3-ba59-83b243971596 req-4b002fdc-1f62-4929-ad20-6e1fe7129a93 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-558f5972-ed03-4aa3-ba59-83b243971596 req-4b002fdc-1f62-4929-ad20-6e1fe7129a93 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-558f5972-ed03-4aa3-ba59-83b243971596 req-4b002fdc-1f62-4929-ad20-6e1fe7129a93 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-558f5972-ed03-4aa3-ba59-83b243971596 req-4b002fdc-1f62-4929-ad20-6e1fe7129a93 service nova] Creating event network-changed:6ea4c00e-5d4b-4375-9b8d-60177a6ec526 for instance 24d1359d-2dcd-46d7-90f3-3801df9be357 on user Apr 14 03:14:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-558f5972-ed03-4aa3-ba59-83b243971596 req-4b002fdc-1f62-4929-ad20-6e1fe7129a93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033171 Apr 14 03:14:14 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 243/733] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-463419112", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "e6bbbad8-4a73-4b93-8464-08be8f6681de"}], "security_groups": [{"name": "tempest-securitygroup--1450832286"}], "key_name": "tempest-keypair-368632906", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "7378e388-0e78-4212-b0ce-a1e082ba31ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:17 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] validate_networks() for [('e6bbbad8-4a73-4b93-8464-08be8f6681de', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for user 7dea23743ba945c4a9d539b8e277c653 and project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:14:18 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7378e388-0e78-4212-b0ce-a1e082ba31ab',volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:14:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5143b4d4-ae15-4d5c-a126-ae638aefefcb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.828050 Apr 14 03:14:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 246/734] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:14:17 2023] POST /compute/v2.1/servers => generated 404 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:14:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-42c3d1c7-c41d-4e34-825d-bd7e5771ecc2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:18 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-42c3d1c7-c41d-4e34-825d-bd7e5771ecc2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:18 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-42c3d1c7-c41d-4e34-825d-bd7e5771ecc2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-42c3d1c7-c41d-4e34-825d-bd7e5771ecc2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 200 len: 1074 microversion: 2.1 time: 0.065702 Apr 14 03:14:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 246/735] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:18 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 1074 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:21 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-ea5ca8ac-4152-4422-a941-788d63ebb72c req-778e0068-c5b1-4f3e-8647-03779c4ace8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ea5ca8ac-4152-4422-a941-788d63ebb72c req-778e0068-c5b1-4f3e-8647-03779c4ace8e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ea5ca8ac-4152-4422-a941-788d63ebb72c req-778e0068-c5b1-4f3e-8647-03779c4ace8e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-ea5ca8ac-4152-4422-a941-788d63ebb72c req-778e0068-c5b1-4f3e-8647-03779c4ace8e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-ea5ca8ac-4152-4422-a941-788d63ebb72c req-778e0068-c5b1-4f3e-8647-03779c4ace8e service nova] Creating event network-changed:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:14:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-ea5ca8ac-4152-4422-a941-788d63ebb72c req-778e0068-c5b1-4f3e-8647-03779c4ace8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031462 Apr 14 03:14:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 244/736] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: bd5b587d-58a9-411b-a755-67adaa6bd6c9] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:22 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-325ec8ff-f43d-45f0-a2cc-c7df5893a2d4 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9" status: 200 len: 1691 microversion: 2.87 time: 0.195965 Apr 14 03:14:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 247/737] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:14:22 2023] GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9 => generated 1691 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:14:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-25c524ef-c7e7-4630-b25b-96fc6a57c7d3 req-3c7f162f-b8eb-4f7d-aa8a-c30bc8fbea85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "name": "network-vif-plugged", "status": "completed", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:27 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=9 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-25c524ef-c7e7-4630-b25b-96fc6a57c7d3 req-3c7f162f-b8eb-4f7d-aa8a-c30bc8fbea85 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-25c524ef-c7e7-4630-b25b-96fc6a57c7d3 req-3c7f162f-b8eb-4f7d-aa8a-c30bc8fbea85 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-25c524ef-c7e7-4630-b25b-96fc6a57c7d3 req-3c7f162f-b8eb-4f7d-aa8a-c30bc8fbea85 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-25c524ef-c7e7-4630-b25b-96fc6a57c7d3 req-3c7f162f-b8eb-4f7d-aa8a-c30bc8fbea85 service nova] Creating event network-vif-plugged:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:14:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-25c524ef-c7e7-4630-b25b-96fc6a57c7d3 req-3c7f162f-b8eb-4f7d-aa8a-c30bc8fbea85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067762 Apr 14 03:14:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 247/738] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-9c7cf017-286d-4da6-ad37-d9f344b6b18f req-ef7a0b93-0bfa-41ab-8fe6-775d19d00461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "name": "network-vif-plugged", "status": "completed", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9c7cf017-286d-4da6-ad37-d9f344b6b18f req-ef7a0b93-0bfa-41ab-8fe6-775d19d00461 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9c7cf017-286d-4da6-ad37-d9f344b6b18f req-ef7a0b93-0bfa-41ab-8fe6-775d19d00461 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9c7cf017-286d-4da6-ad37-d9f344b6b18f req-ef7a0b93-0bfa-41ab-8fe6-775d19d00461 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-9c7cf017-286d-4da6-ad37-d9f344b6b18f req-ef7a0b93-0bfa-41ab-8fe6-775d19d00461 service nova] Creating event network-vif-plugged:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:14:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-9c7cf017-286d-4da6-ad37-d9f344b6b18f req-ef7a0b93-0bfa-41ab-8fe6-775d19d00461 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029452 Apr 14 03:14:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 245/739] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3a02a3bc-446a-4291-8e59-fd300c2f8bee tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3a02a3bc-446a-4291-8e59-fd300c2f8bee tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3a02a3bc-446a-4291-8e59-fd300c2f8bee tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3a02a3bc-446a-4291-8e59-fd300c2f8bee tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3a02a3bc-446a-4291-8e59-fd300c2f8bee tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3a02a3bc-446a-4291-8e59-fd300c2f8bee tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3a02a3bc-446a-4291-8e59-fd300c2f8bee tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3a02a3bc-446a-4291-8e59-fd300c2f8bee tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:30 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-3a02a3bc-446a-4291-8e59-fd300c2f8bee tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8614e27c65428d92e4bf01969976e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0096d0892acf4d5f8a0fa290a18b451a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3a02a3bc-446a-4291-8e59-fd300c2f8bee tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4" status: 200 len: 1566 microversion: 2.1 time: 0.166242 Apr 14 03:14:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 248/740] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:30 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=9 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-977fd0e4-512b-4d40-b2a8-c65a92e6e307 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-977fd0e4-512b-4d40-b2a8-c65a92e6e307 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 5d0f51bd-b28d-4db1-be36-cec6cc92231e] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-977fd0e4-512b-4d40-b2a8-c65a92e6e307 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-977fd0e4-512b-4d40-b2a8-c65a92e6e307 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-977fd0e4-512b-4d40-b2a8-c65a92e6e307 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-977fd0e4-512b-4d40-b2a8-c65a92e6e307 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-977fd0e4-512b-4d40-b2a8-c65a92e6e307 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-977fd0e4-512b-4d40-b2a8-c65a92e6e307 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:42 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-977fd0e4-512b-4d40-b2a8-c65a92e6e307 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-977fd0e4-512b-4d40-b2a8-c65a92e6e307 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e" status: 200 len: 1442 microversion: 2.1 time: 0.227147 Apr 14 03:14:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 248/741] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:42 2023] GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e => generated 1442 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:44 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:44 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-be61977d-6d8f-4ad9-b1e1-f727b96ef9e7 req-e5f7b6d4-e02b-4378-8c03-a4daac7c8d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d0f51bd-b28d-4db1-be36-cec6cc92231e", "tag": "2885c06a-4dea-452f-a76a-e6a12bb525cc"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-be61977d-6d8f-4ad9-b1e1-f727b96ef9e7 req-e5f7b6d4-e02b-4378-8c03-a4daac7c8d40 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-be61977d-6d8f-4ad9-b1e1-f727b96ef9e7 req-e5f7b6d4-e02b-4378-8c03-a4daac7c8d40 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-be61977d-6d8f-4ad9-b1e1-f727b96ef9e7 req-e5f7b6d4-e02b-4378-8c03-a4daac7c8d40 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-be61977d-6d8f-4ad9-b1e1-f727b96ef9e7 req-e5f7b6d4-e02b-4378-8c03-a4daac7c8d40 service nova] Creating event network-changed:2885c06a-4dea-452f-a76a-e6a12bb525cc for instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e on user Apr 14 03:14:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-be61977d-6d8f-4ad9-b1e1-f727b96ef9e7 req-e5f7b6d4-e02b-4378-8c03-a4daac7c8d40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035117 Apr 14 03:14:44 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 246/742] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 5d0f51bd-b28d-4db1-be36-cec6cc92231e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-5af424a8-4bc9-421e-8f91-a3c67156f839 req-e664e2a9-1ec1-4478-94a3-581820595f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d0f51bd-b28d-4db1-be36-cec6cc92231e", "tag": "2885c06a-4dea-452f-a76a-e6a12bb525cc"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:45 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 5d0f51bd-b28d-4db1-be36-cec6cc92231e] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:14:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5af424a8-4bc9-421e-8f91-a3c67156f839 req-e664e2a9-1ec1-4478-94a3-581820595f85 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5af424a8-4bc9-421e-8f91-a3c67156f839 req-e664e2a9-1ec1-4478-94a3-581820595f85 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5af424a8-4bc9-421e-8f91-a3c67156f839 req-e664e2a9-1ec1-4478-94a3-581820595f85 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5af424a8-4bc9-421e-8f91-a3c67156f839 req-e664e2a9-1ec1-4478-94a3-581820595f85 service nova] Creating event network-changed:2885c06a-4dea-452f-a76a-e6a12bb525cc for instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e on user Apr 14 03:14:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-5af424a8-4bc9-421e-8f91-a3c67156f839 req-e664e2a9-1ec1-4478-94a3-581820595f85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057423 Apr 14 03:14:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 249/743] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e" status: 204 len: 0 microversion: 2.1 time: 0.120950 Apr 14 03:14:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 249/744] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:14:45 2023] DELETE /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:14:45 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-02621cae-4d31-4470-86b4-57a2131c5780 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:45 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-02621cae-4d31-4470-86b4-57a2131c5780 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 5d0f51bd-b28d-4db1-be36-cec6cc92231e] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-02621cae-4d31-4470-86b4-57a2131c5780 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-02621cae-4d31-4470-86b4-57a2131c5780 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-02621cae-4d31-4470-86b4-57a2131c5780 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-02621cae-4d31-4470-86b4-57a2131c5780 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-02621cae-4d31-4470-86b4-57a2131c5780 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-02621cae-4d31-4470-86b4-57a2131c5780 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:45 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-02621cae-4d31-4470-86b4-57a2131c5780 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:45 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-02621cae-4d31-4470-86b4-57a2131c5780 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e" status: 200 len: 1566 microversion: 2.1 time: 0.264756 Apr 14 03:14:45 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 247/745] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:45 2023] GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e => generated 1566 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-29f26d0e-2884-48ec-b03e-a2969848e3b9 req-ab6afeef-d093-4b3e-bc2b-0b8cd9bb6ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f51bd-b28d-4db1-be36-cec6cc92231e", "name": "network-vif-deleted", "tag": "2885c06a-4dea-452f-a76a-e6a12bb525cc"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-29f26d0e-2884-48ec-b03e-a2969848e3b9 req-ab6afeef-d093-4b3e-bc2b-0b8cd9bb6ce3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-29f26d0e-2884-48ec-b03e-a2969848e3b9 req-ab6afeef-d093-4b3e-bc2b-0b8cd9bb6ce3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-29f26d0e-2884-48ec-b03e-a2969848e3b9 req-ab6afeef-d093-4b3e-bc2b-0b8cd9bb6ce3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-29f26d0e-2884-48ec-b03e-a2969848e3b9 req-ab6afeef-d093-4b3e-bc2b-0b8cd9bb6ce3 service nova] Creating event network-vif-deleted:2885c06a-4dea-452f-a76a-e6a12bb525cc for instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e on user Apr 14 03:14:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-29f26d0e-2884-48ec-b03e-a2969848e3b9 req-ab6afeef-d093-4b3e-bc2b-0b8cd9bb6ce3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034223 Apr 14 03:14:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 250/746] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-0efea8b1-cbcb-44f3-8b08-e563e79d2ad5 req-cc9e9edb-00aa-4640-a1a5-4eb734c4d507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f51bd-b28d-4db1-be36-cec6cc92231e", "name": "network-vif-unplugged", "status": "completed", "tag": "2885c06a-4dea-452f-a76a-e6a12bb525cc"}, {"server_uuid": "5d0f51bd-b28d-4db1-be36-cec6cc92231e", "name": "network-vif-plugged", "status": "completed", "tag": "2885c06a-4dea-452f-a76a-e6a12bb525cc"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0efea8b1-cbcb-44f3-8b08-e563e79d2ad5 req-cc9e9edb-00aa-4640-a1a5-4eb734c4d507 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0efea8b1-cbcb-44f3-8b08-e563e79d2ad5 req-cc9e9edb-00aa-4640-a1a5-4eb734c4d507 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0efea8b1-cbcb-44f3-8b08-e563e79d2ad5 req-cc9e9edb-00aa-4640-a1a5-4eb734c4d507 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0efea8b1-cbcb-44f3-8b08-e563e79d2ad5 req-cc9e9edb-00aa-4640-a1a5-4eb734c4d507 service nova] Creating event network-vif-unplugged:2885c06a-4dea-452f-a76a-e6a12bb525cc for instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e on user Apr 14 03:14:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0efea8b1-cbcb-44f3-8b08-e563e79d2ad5 req-cc9e9edb-00aa-4640-a1a5-4eb734c4d507 service nova] Creating event network-vif-plugged:2885c06a-4dea-452f-a76a-e6a12bb525cc for instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e on user Apr 14 03:14:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-0efea8b1-cbcb-44f3-8b08-e563e79d2ad5 req-cc9e9edb-00aa-4640-a1a5-4eb734c4d507 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033417 Apr 14 03:14:47 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 250/747] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:47 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:51 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-1942bf27-8132-42a5-aadc-0d5270932109 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:51 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-1942bf27-8132-42a5-aadc-0d5270932109 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1942bf27-8132-42a5-aadc-0d5270932109 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1942bf27-8132-42a5-aadc-0d5270932109 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1942bf27-8132-42a5-aadc-0d5270932109 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1942bf27-8132-42a5-aadc-0d5270932109 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1942bf27-8132-42a5-aadc-0d5270932109 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1942bf27-8132-42a5-aadc-0d5270932109 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:52 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-1942bf27-8132-42a5-aadc-0d5270932109 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c683fe5636b49858857033797ff8e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb4fbf55f04294a3d97800142bdca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:52 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-1942bf27-8132-42a5-aadc-0d5270932109 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3" status: 200 len: 1705 microversion: 2.1 time: 0.165717 Apr 14 03:14:52 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 248/748] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:51 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3 => generated 1705 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: ac032176-63bc-457c-ad53-5b4a854eec34] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] HTTP exception thrown: Instance ac032176-63bc-457c-ad53-5b4a854eec34 could not be found. Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Request method failure captured: Apr 14 03:14:53 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34 HTTP/1.1 Apr 14 03:14:53 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:14:53 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:14:53 user devstack@n-api.service[61663]: Connection: close Apr 14 03:14:53 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:14:53 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:14:53 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:14:53 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:14:53 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMEwmVtNRDetgWO5mTD1bEUocoJOj9YFGH40WwivXpN1Xs8gxlA0vVPe_uVHwCMswvqd9NviH5dTXLGC0t38Yu4iQwgvLzajFOxfBIuObMRSmhp1Wer7zSPZ6VE5STLyrn3LfTG0y7nuum9vJ4mym9BmUd-cBbpnhMSg3gviUoA8AKw Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Project-Id: 558bfd7e1d9049d396381de148b0c4a5 Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/558bfd7e1d9049d396381de148b0c4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/558bfd7e1d9049d396381de148b0c4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/558bfd7e1d9049d396381de148b0c4a5"}]}] Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Tenant-Id: 558bfd7e1d9049d396381de148b0c4a5 Apr 14 03:14:53 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:14:53 user devstack@n-api.service[61663]: X-User: tempest-ServerRescueNegativeTestJSON-773851452-project-member Apr 14 03:14:53 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:14:53 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:14:53 user devstack@n-api.service[61663]: X-User-Id: d5e8150f1502427fb3148f20354d212e Apr 14 03:14:53 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerRescueNegativeTestJSON-773851452-project-member Apr 14 03:14:53 user devstack@n-api.service[61663]: method: > Apr 14 03:14:53 user devstack@n-api.service[61663]: exception: Instance ac032176-63bc-457c-ad53-5b4a854eec34 could not be found. Apr 14 03:14:53 user devstack@n-api.service[61663]: action_args: {'id': 'ac032176-63bc-457c-ad53-5b4a854eec34'} Apr 14 03:14:53 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac032176-63bc-457c-ad53-5b4a854eec34 could not be found. Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac032176-63bc-457c-ad53-5b4a854eec34 could not be found. Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac032176-63bc-457c-ad53-5b4a854eec34 could not be found. Apr 14 03:14:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Returning 404 to user: Instance ac032176-63bc-457c-ad53-5b4a854eec34 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:14:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-df97ae5d-b7b0-44f6-bde1-7bd063e00b06 tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34" status: 404 len: 111 microversion: 2.1 time: 0.155617 Apr 14 03:14:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 251/749] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:53 2023] GET /compute/v2.1/servers/ac032176-63bc-457c-ad53-5b4a854eec34 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:14:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3c054b53-f863-4c88-a4a1-d1ae63c5330b tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:53 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3c054b53-f863-4c88-a4a1-d1ae63c5330b tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c054b53-f863-4c88-a4a1-d1ae63c5330b tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c054b53-f863-4c88-a4a1-d1ae63c5330b tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c054b53-f863-4c88-a4a1-d1ae63c5330b tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c054b53-f863-4c88-a4a1-d1ae63c5330b tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c054b53-f863-4c88-a4a1-d1ae63c5330b tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c054b53-f863-4c88-a4a1-d1ae63c5330b tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:53 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3c054b53-f863-4c88-a4a1-d1ae63c5330b tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:14:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3c054b53-f863-4c88-a4a1-d1ae63c5330b tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6" status: 204 len: 0 microversion: 2.1 time: 0.137322 Apr 14 03:14:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 251/750] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:14:53 2023] DELETE /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:14:53 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d2562cfd-7e1b-4919-9381-7c1b85c21f9f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:53 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d2562cfd-7e1b-4919-9381-7c1b85c21f9f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2562cfd-7e1b-4919-9381-7c1b85c21f9f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2562cfd-7e1b-4919-9381-7c1b85c21f9f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2562cfd-7e1b-4919-9381-7c1b85c21f9f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2562cfd-7e1b-4919-9381-7c1b85c21f9f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2562cfd-7e1b-4919-9381-7c1b85c21f9f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d2562cfd-7e1b-4919-9381-7c1b85c21f9f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:53 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-d2562cfd-7e1b-4919-9381-7c1b85c21f9f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e8150f1502427fb3148f20354d212e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '558bfd7e1d9049d396381de148b0c4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:53 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d2562cfd-7e1b-4919-9381-7c1b85c21f9f tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6" status: 200 len: 1509 microversion: 2.1 time: 0.165168 Apr 14 03:14:53 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 249/751] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:53 2023] GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-da9ca23a-004a-478d-a14d-8b9451aff0cd req-32a148d3-1a01-49eb-8493-a3fb78270737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-unplugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-da9ca23a-004a-478d-a14d-8b9451aff0cd req-32a148d3-1a01-49eb-8493-a3fb78270737 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-da9ca23a-004a-478d-a14d-8b9451aff0cd req-32a148d3-1a01-49eb-8493-a3fb78270737 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-da9ca23a-004a-478d-a14d-8b9451aff0cd req-32a148d3-1a01-49eb-8493-a3fb78270737 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-da9ca23a-004a-478d-a14d-8b9451aff0cd req-32a148d3-1a01-49eb-8493-a3fb78270737 service nova] Creating event network-vif-unplugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:14:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-da9ca23a-004a-478d-a14d-8b9451aff0cd req-32a148d3-1a01-49eb-8493-a3fb78270737 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035213 Apr 14 03:14:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 252/752] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e428638c-a328-43e8-a56e-e44463f3b8d5 req-69b31838-ac17-49c3-9e4d-0bcfaedd756d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-deleted", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e428638c-a328-43e8-a56e-e44463f3b8d5 req-69b31838-ac17-49c3-9e4d-0bcfaedd756d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e428638c-a328-43e8-a56e-e44463f3b8d5 req-69b31838-ac17-49c3-9e4d-0bcfaedd756d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e428638c-a328-43e8-a56e-e44463f3b8d5 req-69b31838-ac17-49c3-9e4d-0bcfaedd756d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e428638c-a328-43e8-a56e-e44463f3b8d5 req-69b31838-ac17-49c3-9e4d-0bcfaedd756d service nova] Creating event network-vif-deleted:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:14:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e428638c-a328-43e8-a56e-e44463f3b8d5 req-69b31838-ac17-49c3-9e4d-0bcfaedd756d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030667 Apr 14 03:14:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 252/753] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:55 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] [instance: 0708e26d-9d20-4cb0-9b8c-76249f74f0a2] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:55 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] HTTP exception thrown: Instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 could not be found. Apr 14 03:14:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Request method failure captured: Apr 14 03:14:55 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2 HTTP/1.1 Apr 14 03:14:55 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:14:55 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:14:55 user devstack@n-api.service[61662]: Connection: close Apr 14 03:14:55 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:14:55 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:14:55 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:14:55 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:14:55 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMOkhglPBD8_hYeo-qfGRUi6934zWZC9zn3oOinaxJBtrz-A-MlpoowGYd50VELUVh1VVnDwStKxeGgMl3zIfEz6Q3QOv6w_WhMqAtj6k1xvbHIWoAsG0IhJJy7nJq8RC-soSCOZI55WaY19hHAHvWFXfXMtViBMGRJ7o5Z-bGvCga4 Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Project-Id: 4549f6080dcf4c739ac03ef643801fbc Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Project-Name: tempest-VolumesSnapshotTestJSON-423841644 Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4549f6080dcf4c739ac03ef643801fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4549f6080dcf4c739ac03ef643801fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4549f6080dcf4c739ac03ef643801fbc"}]}] Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Tenant: tempest-VolumesSnapshotTestJSON-423841644 Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Tenant-Id: 4549f6080dcf4c739ac03ef643801fbc Apr 14 03:14:55 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-423841644 Apr 14 03:14:55 user devstack@n-api.service[61662]: X-User: tempest-VolumesSnapshotTestJSON-423841644-project-member Apr 14 03:14:55 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:14:55 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:14:55 user devstack@n-api.service[61662]: X-User-Id: 0128a733bd6a4120addba5eda1cc05fb Apr 14 03:14:55 user devstack@n-api.service[61662]: X-User-Name: tempest-VolumesSnapshotTestJSON-423841644-project-member Apr 14 03:14:55 user devstack@n-api.service[61662]: method: > Apr 14 03:14:55 user devstack@n-api.service[61662]: exception: Instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 could not be found. Apr 14 03:14:55 user devstack@n-api.service[61662]: action_args: {'id': '0708e26d-9d20-4cb0-9b8c-76249f74f0a2'} Apr 14 03:14:55 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 could not be found. Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 could not be found. Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 could not be found. Apr 14 03:14:55 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:14:55 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] Returning 404 to user: Instance 0708e26d-9d20-4cb0-9b8c-76249f74f0a2 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:14:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-fd9c89dd-4914-4d91-bae8-c4f1824e3c2d tempest-VolumesSnapshotTestJSON-423841644 tempest-VolumesSnapshotTestJSON-423841644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2" status: 404 len: 111 microversion: 2.1 time: 0.029339 Apr 14 03:14:55 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 250/754] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:55 2023] GET /compute/v2.1/servers/0708e26d-9d20-4cb0-9b8c-76249f74f0a2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:14:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-42ed1a6b-9e94-4fef-80ea-cbbfd385b49e req-3ad96b54-2d6f-4319-b7d2-c6c16c702e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}, {"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}, {"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}, {"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-unplugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}, {"server_uuid": "5e57cef1-b6cd-4291-a4c5-60e9dd22aed6", "name": "network-vif-plugged", "status": "completed", "tag": "1319e09d-3a9f-404b-862d-37b385badb8d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-42ed1a6b-9e94-4fef-80ea-cbbfd385b49e req-3ad96b54-2d6f-4319-b7d2-c6c16c702e95 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-42ed1a6b-9e94-4fef-80ea-cbbfd385b49e req-3ad96b54-2d6f-4319-b7d2-c6c16c702e95 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-42ed1a6b-9e94-4fef-80ea-cbbfd385b49e req-3ad96b54-2d6f-4319-b7d2-c6c16c702e95 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-42ed1a6b-9e94-4fef-80ea-cbbfd385b49e req-3ad96b54-2d6f-4319-b7d2-c6c16c702e95 service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:14:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-42ed1a6b-9e94-4fef-80ea-cbbfd385b49e req-3ad96b54-2d6f-4319-b7d2-c6c16c702e95 service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:14:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-42ed1a6b-9e94-4fef-80ea-cbbfd385b49e req-3ad96b54-2d6f-4319-b7d2-c6c16c702e95 service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:14:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-42ed1a6b-9e94-4fef-80ea-cbbfd385b49e req-3ad96b54-2d6f-4319-b7d2-c6c16c702e95 service nova] Creating event network-vif-unplugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:14:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-42ed1a6b-9e94-4fef-80ea-cbbfd385b49e req-3ad96b54-2d6f-4319-b7d2-c6c16c702e95 service nova] Creating event network-vif-plugged:1319e09d-3a9f-404b-862d-37b385badb8d for instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 on user Apr 14 03:14:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-42ed1a6b-9e94-4fef-80ea-cbbfd385b49e req-3ad96b54-2d6f-4319-b7d2-c6c16c702e95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.033200 Apr 14 03:14:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 253/755] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:55 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:14:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6d5c9019-1ec9-43df-9e8b-5ad7be98530a tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:59 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6d5c9019-1ec9-43df-9e8b-5ad7be98530a tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: d309dc50-d3b0-47a4-b263-a67ae96e2f5b] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d5c9019-1ec9-43df-9e8b-5ad7be98530a tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d5c9019-1ec9-43df-9e8b-5ad7be98530a tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d5c9019-1ec9-43df-9e8b-5ad7be98530a tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d5c9019-1ec9-43df-9e8b-5ad7be98530a tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d5c9019-1ec9-43df-9e8b-5ad7be98530a tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6d5c9019-1ec9-43df-9e8b-5ad7be98530a tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:59 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6d5c9019-1ec9-43df-9e8b-5ad7be98530a tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: d309dc50-d3b0-47a4-b263-a67ae96e2f5b] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:14:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6d5c9019-1ec9-43df-9e8b-5ad7be98530a tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b" status: 204 len: 0 microversion: 2.1 time: 0.123320 Apr 14 03:14:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 253/756] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:14:59 2023] DELETE /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:14:59 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-8a8c2cd6-0e68-491a-b910-3394ba96efdc tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:14:59 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-8a8c2cd6-0e68-491a-b910-3394ba96efdc tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: d309dc50-d3b0-47a4-b263-a67ae96e2f5b] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:14:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8a8c2cd6-0e68-491a-b910-3394ba96efdc tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8a8c2cd6-0e68-491a-b910-3394ba96efdc tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8a8c2cd6-0e68-491a-b910-3394ba96efdc tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8a8c2cd6-0e68-491a-b910-3394ba96efdc tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8a8c2cd6-0e68-491a-b910-3394ba96efdc tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:59 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8a8c2cd6-0e68-491a-b910-3394ba96efdc tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:59 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-8a8c2cd6-0e68-491a-b910-3394ba96efdc tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2facbf385e8402c86706cc28d4707af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1318728a20064d49b9c1b2f89175a364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:14:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-8a8c2cd6-0e68-491a-b910-3394ba96efdc tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b" status: 200 len: 1492 microversion: 2.1 time: 0.192028 Apr 14 03:14:59 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 251/757] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:14:59 2023] GET /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b => generated 1492 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:14:59 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-7807e2c4-6569-4d59-b842-773f5f26f248 req-bd4e7366-40ec-4171-b42f-3ba3e29e6e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d309dc50-d3b0-47a4-b263-a67ae96e2f5b", "name": "network-vif-unplugged", "status": "completed", "tag": "2749fb25-d2ff-43bb-b58c-f1d7694570de"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:14:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7807e2c4-6569-4d59-b842-773f5f26f248 req-bd4e7366-40ec-4171-b42f-3ba3e29e6e32 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:14:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7807e2c4-6569-4d59-b842-773f5f26f248 req-bd4e7366-40ec-4171-b42f-3ba3e29e6e32 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:14:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7807e2c4-6569-4d59-b842-773f5f26f248 req-bd4e7366-40ec-4171-b42f-3ba3e29e6e32 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:14:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-7807e2c4-6569-4d59-b842-773f5f26f248 req-bd4e7366-40ec-4171-b42f-3ba3e29e6e32 service nova] Creating event network-vif-unplugged:2749fb25-d2ff-43bb-b58c-f1d7694570de for instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b on user Apr 14 03:14:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-7807e2c4-6569-4d59-b842-773f5f26f248 req-bd4e7366-40ec-4171-b42f-3ba3e29e6e32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149842 Apr 14 03:14:59 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 254/758] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:14:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-59ebf3bc-0b68-4280-a732-d6adef40658d req-d50b5033-126d-42af-a784-a1d9d9290c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d309dc50-d3b0-47a4-b263-a67ae96e2f5b", "name": "network-vif-deleted", "tag": "2749fb25-d2ff-43bb-b58c-f1d7694570de"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-59ebf3bc-0b68-4280-a732-d6adef40658d req-d50b5033-126d-42af-a784-a1d9d9290c45 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-59ebf3bc-0b68-4280-a732-d6adef40658d req-d50b5033-126d-42af-a784-a1d9d9290c45 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-59ebf3bc-0b68-4280-a732-d6adef40658d req-d50b5033-126d-42af-a784-a1d9d9290c45 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-59ebf3bc-0b68-4280-a732-d6adef40658d req-d50b5033-126d-42af-a784-a1d9d9290c45 service nova] Creating event network-vif-deleted:2749fb25-d2ff-43bb-b58c-f1d7694570de for instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b on user Apr 14 03:15:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-59ebf3bc-0b68-4280-a732-d6adef40658d req-d50b5033-126d-42af-a784-a1d9d9290c45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033392 Apr 14 03:15:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 254/759] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:01 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-0c40fc34-d7c1-4bce-a25e-7b92725ae162 req-34bbeb8f-1d52-4810-9bdb-f41675b47114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d309dc50-d3b0-47a4-b263-a67ae96e2f5b", "name": "network-vif-plugged", "status": "completed", "tag": "2749fb25-d2ff-43bb-b58c-f1d7694570de"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0c40fc34-d7c1-4bce-a25e-7b92725ae162 req-34bbeb8f-1d52-4810-9bdb-f41675b47114 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0c40fc34-d7c1-4bce-a25e-7b92725ae162 req-34bbeb8f-1d52-4810-9bdb-f41675b47114 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:01 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0c40fc34-d7c1-4bce-a25e-7b92725ae162 req-34bbeb8f-1d52-4810-9bdb-f41675b47114 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-0c40fc34-d7c1-4bce-a25e-7b92725ae162 req-34bbeb8f-1d52-4810-9bdb-f41675b47114 service nova] Creating event network-vif-plugged:2749fb25-d2ff-43bb-b58c-f1d7694570de for instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b on user Apr 14 03:15:01 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-0c40fc34-d7c1-4bce-a25e-7b92725ae162 req-34bbeb8f-1d52-4810-9bdb-f41675b47114 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037178 Apr 14 03:15:01 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 252/760] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:08 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b60a7900-ae6a-46ae-bffd-5bc6c0be5e82 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:08 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b60a7900-ae6a-46ae-bffd-5bc6c0be5e82 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b60a7900-ae6a-46ae-bffd-5bc6c0be5e82 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b60a7900-ae6a-46ae-bffd-5bc6c0be5e82 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b60a7900-ae6a-46ae-bffd-5bc6c0be5e82 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b60a7900-ae6a-46ae-bffd-5bc6c0be5e82 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b60a7900-ae6a-46ae-bffd-5bc6c0be5e82 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b60a7900-ae6a-46ae-bffd-5bc6c0be5e82 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:08 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-b60a7900-ae6a-46ae-bffd-5bc6c0be5e82 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:15:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b60a7900-ae6a-46ae-bffd-5bc6c0be5e82 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 200 len: 1427 microversion: 2.1 time: 0.149961 Apr 14 03:15:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 255/761] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:15:08 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 1427 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:15:22 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:22 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-35f41c24-c38d-4f02-a5a3-385eca5733ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1052478341"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:22 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-35f41c24-c38d-4f02-a5a3-385eca5733ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: bd5b587d-58a9-411b-a755-67adaa6bd6c9] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35f41c24-c38d-4f02-a5a3-385eca5733ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35f41c24-c38d-4f02-a5a3-385eca5733ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35f41c24-c38d-4f02-a5a3-385eca5733ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35f41c24-c38d-4f02-a5a3-385eca5733ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35f41c24-c38d-4f02-a5a3-385eca5733ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35f41c24-c38d-4f02-a5a3-385eca5733ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-35f41c24-c38d-4f02-a5a3-385eca5733ab tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9/action" status: 202 len: 52 microversion: 2.87 time: 0.956898 Apr 14 03:15:23 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 255/762] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 03:15:22 2023] POST /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9/action => generated 52 bytes in 962 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=14 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=30 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: bd5b587d-58a9-411b-a755-67adaa6bd6c9] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:15:28 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:15:28 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-93577a2a-d868-4863-9290-bed38f0607c3 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9" status: 200 len: 1691 microversion: 2.87 time: 0.166030 Apr 14 03:15:28 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 253/763] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:15:28 2023] GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c3263cc4-8937-4d5a-8b2a-08e80111975e tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c3263cc4-8937-4d5a-8b2a-08e80111975e tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=16 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=24 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c3263cc4-8937-4d5a-8b2a-08e80111975e tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c3263cc4-8937-4d5a-8b2a-08e80111975e tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c3263cc4-8937-4d5a-8b2a-08e80111975e tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c3263cc4-8937-4d5a-8b2a-08e80111975e tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c3263cc4-8937-4d5a-8b2a-08e80111975e tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c3263cc4-8937-4d5a-8b2a-08e80111975e tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:30 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c3263cc4-8937-4d5a-8b2a-08e80111975e tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8614e27c65428d92e4bf01969976e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0096d0892acf4d5f8a0fa290a18b451a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:15:30 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c3263cc4-8937-4d5a-8b2a-08e80111975e tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4" status: 200 len: 1566 microversion: 2.1 time: 0.172937 Apr 14 03:15:30 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 256/764] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:15:30 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:35 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-612f766d-7888-4823-8b8e-55ab36be665f req-8a9e6e55-0a8f-4474-8698-1e1f75e76755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4", "tag": "73d42070-416a-497f-b3d4-8467d8255c5f"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 5d0f51bd-b28d-4db1-be36-cec6cc92231e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-612f766d-7888-4823-8b8e-55ab36be665f req-8a9e6e55-0a8f-4474-8698-1e1f75e76755 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-612f766d-7888-4823-8b8e-55ab36be665f req-8a9e6e55-0a8f-4474-8698-1e1f75e76755 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-612f766d-7888-4823-8b8e-55ab36be665f req-8a9e6e55-0a8f-4474-8698-1e1f75e76755 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-612f766d-7888-4823-8b8e-55ab36be665f req-8a9e6e55-0a8f-4474-8698-1e1f75e76755 service nova] Creating event network-changed:73d42070-416a-497f-b3d4-8467d8255c5f for instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 on user Apr 14 03:15:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-612f766d-7888-4823-8b8e-55ab36be665f req-8a9e6e55-0a8f-4474-8698-1e1f75e76755 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030068 Apr 14 03:15:35 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 254/765] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e could not be found. Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:15:35 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e HTTP/1.1 Apr 14 03:15:35 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:15:35 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:15:35 user devstack@n-api.service[61664]: Connection: close Apr 14 03:15:35 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:15:35 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:15:35 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:15:35 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:15:35 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:15:35 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:15:35 user devstack@n-api.service[61664]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:15:35 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:15:35 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:15:35 user devstack@n-api.service[61664]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:15:35 user devstack@n-api.service[61664]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:15:35 user devstack@n-api.service[61664]: method: > Apr 14 03:15:35 user devstack@n-api.service[61664]: exception: Instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e could not be found. Apr 14 03:15:35 user devstack@n-api.service[61664]: action_args: {'id': '5d0f51bd-b28d-4db1-be36-cec6cc92231e'} Apr 14 03:15:35 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e could not be found. Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e could not be found. Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e could not be found. Apr 14 03:15:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:15:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance 5d0f51bd-b28d-4db1-be36-cec6cc92231e could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:15:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-26befa2b-f5b9-458e-a61f-29fa566f7c5f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e" status: 404 len: 111 microversion: 2.1 time: 0.213988 Apr 14 03:15:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 256/766] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:15:35 2023] GET /compute/v2.1/servers/5d0f51bd-b28d-4db1-be36-cec6cc92231e => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:15:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-05135c56-cc6d-4210-8c64-d96fe03acb9c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:35 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-05135c56-cc6d-4210-8c64-d96fe03acb9c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05135c56-cc6d-4210-8c64-d96fe03acb9c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05135c56-cc6d-4210-8c64-d96fe03acb9c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05135c56-cc6d-4210-8c64-d96fe03acb9c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05135c56-cc6d-4210-8c64-d96fe03acb9c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05135c56-cc6d-4210-8c64-d96fe03acb9c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05135c56-cc6d-4210-8c64-d96fe03acb9c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-05135c56-cc6d-4210-8c64-d96fe03acb9c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328861 Apr 14 03:15:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 257/767] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:15:35 2023] POST /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:43 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-841070a3-6c4e-44e1-9802-b5e49847370e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:43 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-841070a3-6c4e-44e1-9802-b5e49847370e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7f542934-641f-405f-811c-3601a3be389b] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-841070a3-6c4e-44e1-9802-b5e49847370e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-841070a3-6c4e-44e1-9802-b5e49847370e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-841070a3-6c4e-44e1-9802-b5e49847370e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-841070a3-6c4e-44e1-9802-b5e49847370e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-841070a3-6c4e-44e1-9802-b5e49847370e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-841070a3-6c4e-44e1-9802-b5e49847370e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-45707cf8-4a27-4c5e-b136-92ff58ec86ce req-ae9262fa-7dee-4359-b3da-0a525cb97ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f542934-641f-405f-811c-3601a3be389b", "tag": "1ccf0327-517f-45c5-a995-1b3a7fcfdaf9"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-45707cf8-4a27-4c5e-b136-92ff58ec86ce req-ae9262fa-7dee-4359-b3da-0a525cb97ac8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-45707cf8-4a27-4c5e-b136-92ff58ec86ce req-ae9262fa-7dee-4359-b3da-0a525cb97ac8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-45707cf8-4a27-4c5e-b136-92ff58ec86ce req-ae9262fa-7dee-4359-b3da-0a525cb97ac8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:43 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-841070a3-6c4e-44e1-9802-b5e49847370e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7f542934-641f-405f-811c-3601a3be389b] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:15:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-45707cf8-4a27-4c5e-b136-92ff58ec86ce req-ae9262fa-7dee-4359-b3da-0a525cb97ac8 service nova] Creating event network-changed:1ccf0327-517f-45c5-a995-1b3a7fcfdaf9 for instance 7f542934-641f-405f-811c-3601a3be389b on user Apr 14 03:15:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-45707cf8-4a27-4c5e-b136-92ff58ec86ce req-ae9262fa-7dee-4359-b3da-0a525cb97ac8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039635 Apr 14 03:15:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 257/768] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-841070a3-6c4e-44e1-9802-b5e49847370e tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b" status: 204 len: 0 microversion: 2.1 time: 0.136506 Apr 14 03:15:43 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 255/769] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:15:43 2023] DELETE /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:15:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-345d1526-e57f-427f-8bc2-5e86517b372f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:43 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-345d1526-e57f-427f-8bc2-5e86517b372f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7f542934-641f-405f-811c-3601a3be389b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-345d1526-e57f-427f-8bc2-5e86517b372f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-345d1526-e57f-427f-8bc2-5e86517b372f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-345d1526-e57f-427f-8bc2-5e86517b372f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-345d1526-e57f-427f-8bc2-5e86517b372f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-345d1526-e57f-427f-8bc2-5e86517b372f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-345d1526-e57f-427f-8bc2-5e86517b372f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] [instance: 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] HTTP exception thrown: Instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 could not be found. Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Request method failure captured: Apr 14 03:15:43 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 HTTP/1.1 Apr 14 03:15:43 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:15:43 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:15:43 user devstack@n-api.service[61664]: Connection: close Apr 14 03:15:43 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:15:43 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:15:43 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:15:43 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:15:43 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEwmVtNRDetgWO5mTD1bEUocoJOj9YFGH40WwivXpN1Xs8gxlA0vVPe_uVHwCMswvqd9NviH5dTXLGC0t38Yu4iQwgvLzajFOxfBIuObMRSmhp1Wer7zSPZ6VE5STLyrn3LfTG0y7nuum9vJ4mym9BmUd-cBbpnhMSg3gviUoA8AKw Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Project-Id: 558bfd7e1d9049d396381de148b0c4a5 Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/558bfd7e1d9049d396381de148b0c4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/558bfd7e1d9049d396381de148b0c4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/558bfd7e1d9049d396381de148b0c4a5"}]}] Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Tenant-Id: 558bfd7e1d9049d396381de148b0c4a5 Apr 14 03:15:43 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-773851452 Apr 14 03:15:43 user devstack@n-api.service[61664]: X-User: tempest-ServerRescueNegativeTestJSON-773851452-project-member Apr 14 03:15:43 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:15:43 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:15:43 user devstack@n-api.service[61664]: X-User-Id: d5e8150f1502427fb3148f20354d212e Apr 14 03:15:43 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-773851452-project-member Apr 14 03:15:43 user devstack@n-api.service[61664]: method: > Apr 14 03:15:43 user devstack@n-api.service[61664]: exception: Instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 could not be found. Apr 14 03:15:43 user devstack@n-api.service[61664]: action_args: {'id': '5e57cef1-b6cd-4291-a4c5-60e9dd22aed6'} Apr 14 03:15:43 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 could not be found. Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 could not be found. Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 could not be found. Apr 14 03:15:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:15:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] Returning 404 to user: Instance 5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:15:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c39b3e0a-bee6-4467-9b94-7c2975d9912c tempest-ServerRescueNegativeTestJSON-773851452 tempest-ServerRescueNegativeTestJSON-773851452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6" status: 404 len: 111 microversion: 2.1 time: 0.042073 Apr 14 03:15:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 258/770] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:15:43 2023] GET /compute/v2.1/servers/5e57cef1-b6cd-4291-a4c5-60e9dd22aed6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:15:44 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-345d1526-e57f-427f-8bc2-5e86517b372f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e11b7ab2914209b23bf7a53791da64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2e49e8e92e416faebf55e3d4e0e087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:15:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-345d1526-e57f-427f-8bc2-5e86517b372f tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b" status: 200 len: 1566 microversion: 2.1 time: 0.392109 Apr 14 03:15:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 258/771] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:15:43 2023] GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b => generated 1566 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:15:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-f5d674d8-5a65-4eef-a633-f7e013351cb7 req-3480bf69-5a00-4d7a-babf-4c2cd08d027d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f542934-641f-405f-811c-3601a3be389b", "name": "network-vif-unplugged", "status": "completed", "tag": "1ccf0327-517f-45c5-a995-1b3a7fcfdaf9"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f5d674d8-5a65-4eef-a633-f7e013351cb7 req-3480bf69-5a00-4d7a-babf-4c2cd08d027d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f5d674d8-5a65-4eef-a633-f7e013351cb7 req-3480bf69-5a00-4d7a-babf-4c2cd08d027d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f5d674d8-5a65-4eef-a633-f7e013351cb7 req-3480bf69-5a00-4d7a-babf-4c2cd08d027d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-f5d674d8-5a65-4eef-a633-f7e013351cb7 req-3480bf69-5a00-4d7a-babf-4c2cd08d027d service nova] Creating event network-vif-unplugged:1ccf0327-517f-45c5-a995-1b3a7fcfdaf9 for instance 7f542934-641f-405f-811c-3601a3be389b on user Apr 14 03:15:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-f5d674d8-5a65-4eef-a633-f7e013351cb7 req-3480bf69-5a00-4d7a-babf-4c2cd08d027d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032891 Apr 14 03:15:44 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 256/772] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-73b1a046-9970-4801-9bc6-0138061542ad req-84b62bfc-94ab-4434-b4ab-46b80e4b27c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f542934-641f-405f-811c-3601a3be389b", "name": "network-vif-plugged", "status": "completed", "tag": "1ccf0327-517f-45c5-a995-1b3a7fcfdaf9"}, {"server_uuid": "7f542934-641f-405f-811c-3601a3be389b", "name": "network-vif-deleted", "tag": "1ccf0327-517f-45c5-a995-1b3a7fcfdaf9"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-73b1a046-9970-4801-9bc6-0138061542ad req-84b62bfc-94ab-4434-b4ab-46b80e4b27c4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-73b1a046-9970-4801-9bc6-0138061542ad req-84b62bfc-94ab-4434-b4ab-46b80e4b27c4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-73b1a046-9970-4801-9bc6-0138061542ad req-84b62bfc-94ab-4434-b4ab-46b80e4b27c4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-73b1a046-9970-4801-9bc6-0138061542ad req-84b62bfc-94ab-4434-b4ab-46b80e4b27c4 service nova] Creating event network-vif-plugged:1ccf0327-517f-45c5-a995-1b3a7fcfdaf9 for instance 7f542934-641f-405f-811c-3601a3be389b on user Apr 14 03:15:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-73b1a046-9970-4801-9bc6-0138061542ad req-84b62bfc-94ab-4434-b4ab-46b80e4b27c4 service nova] Creating event network-vif-deleted:1ccf0327-517f-45c5-a995-1b3a7fcfdaf9 for instance 7f542934-641f-405f-811c-3601a3be389b on user Apr 14 03:15:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-73b1a046-9970-4801-9bc6-0138061542ad req-84b62bfc-94ab-4434-b4ab-46b80e4b27c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034914 Apr 14 03:15:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 259/773] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:49 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] [instance: d309dc50-d3b0-47a4-b263-a67ae96e2f5b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] HTTP exception thrown: Instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b could not be found. Apr 14 03:15:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Request method failure captured: Apr 14 03:15:49 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b HTTP/1.1 Apr 14 03:15:49 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:15:49 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:15:49 user devstack@n-api.service[61663]: Connection: close Apr 14 03:15:49 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:15:49 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:15:49 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:15:49 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:15:49 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMQerL5LRl2Pa0l_piZBZh1NGFRDPXiFK5SSFMLVFEyantTrAlUu0GuYWk9oGbJGM-L0KhweTo09YdinnqZxdjlUcJ-tmjr4ObAtQn9s-U8VDxwL_LHEmyMomVCTCeYgEHZZKetd9wfTjOMT9VsWfLIKpw8u2meGmydgKORA-nRP1gE Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Project-Id: 1318728a20064d49b9c1b2f89175a364 Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesActionsTest-121883605 Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1318728a20064d49b9c1b2f89175a364"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1318728a20064d49b9c1b2f89175a364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1318728a20064d49b9c1b2f89175a364"}]}] Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesActionsTest-121883605 Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Tenant-Id: 1318728a20064d49b9c1b2f89175a364 Apr 14 03:15:49 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesActionsTest-121883605 Apr 14 03:15:49 user devstack@n-api.service[61663]: X-User: tempest-VolumesActionsTest-121883605-project-member Apr 14 03:15:49 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:15:49 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:15:49 user devstack@n-api.service[61663]: X-User-Id: b2facbf385e8402c86706cc28d4707af Apr 14 03:15:49 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesActionsTest-121883605-project-member Apr 14 03:15:49 user devstack@n-api.service[61663]: method: > Apr 14 03:15:49 user devstack@n-api.service[61663]: exception: Instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b could not be found. Apr 14 03:15:49 user devstack@n-api.service[61663]: action_args: {'id': 'd309dc50-d3b0-47a4-b263-a67ae96e2f5b'} Apr 14 03:15:49 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b could not be found. Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b could not be found. Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b could not be found. Apr 14 03:15:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:15:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] Returning 404 to user: Instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:15:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-dd3cd08c-d969-4234-b393-0cc147211c7c tempest-VolumesActionsTest-121883605 tempest-VolumesActionsTest-121883605-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b" status: 404 len: 111 microversion: 2.1 time: 0.309676 Apr 14 03:15:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 259/774] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:15:49 2023] GET /compute/v2.1/servers/d309dc50-d3b0-47a4-b263-a67ae96e2f5b => generated 111 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:15:52 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-7d6c79c2-40de-4fac-8d46-ef73f54753c0 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:52 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-7d6c79c2-40de-4fac-8d46-ef73f54753c0 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d6c79c2-40de-4fac-8d46-ef73f54753c0 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d6c79c2-40de-4fac-8d46-ef73f54753c0 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d6c79c2-40de-4fac-8d46-ef73f54753c0 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d6c79c2-40de-4fac-8d46-ef73f54753c0 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d6c79c2-40de-4fac-8d46-ef73f54753c0 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:52 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d6c79c2-40de-4fac-8d46-ef73f54753c0 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:52 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-7d6c79c2-40de-4fac-8d46-ef73f54753c0 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/action" status: 202 len: 0 microversion: 2.1 time: 0.220563 Apr 14 03:15:52 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 257/775] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:15:52 2023] POST /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:15:52 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f45a9e30-588e-4d1a-a45b-d8349ecd0c17 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:52 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f45a9e30-588e-4d1a-a45b-d8349ecd0c17 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f45a9e30-588e-4d1a-a45b-d8349ecd0c17 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f45a9e30-588e-4d1a-a45b-d8349ecd0c17 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f45a9e30-588e-4d1a-a45b-d8349ecd0c17 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f45a9e30-588e-4d1a-a45b-d8349ecd0c17 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f45a9e30-588e-4d1a-a45b-d8349ecd0c17 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f45a9e30-588e-4d1a-a45b-d8349ecd0c17 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f45a9e30-588e-4d1a-a45b-d8349ecd0c17 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.142173 Apr 14 03:15:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 260/776] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:15:52 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-interface => generated 283 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-36ed31be-a2c0-4e56-9a5a-03c1f0d6cbad req-0e1060dd-004e-40ec-abe2-f0f22e9cd650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-unplugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-36ed31be-a2c0-4e56-9a5a-03c1f0d6cbad req-0e1060dd-004e-40ec-abe2-f0f22e9cd650 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-36ed31be-a2c0-4e56-9a5a-03c1f0d6cbad req-0e1060dd-004e-40ec-abe2-f0f22e9cd650 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-36ed31be-a2c0-4e56-9a5a-03c1f0d6cbad req-0e1060dd-004e-40ec-abe2-f0f22e9cd650 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-36ed31be-a2c0-4e56-9a5a-03c1f0d6cbad req-0e1060dd-004e-40ec-abe2-f0f22e9cd650 service nova] Creating event network-vif-unplugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:15:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-36ed31be-a2c0-4e56-9a5a-03c1f0d6cbad req-0e1060dd-004e-40ec-abe2-f0f22e9cd650 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049309 Apr 14 03:15:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 260/777] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:53 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-cbc902c6-c96e-482b-836b-42016da98a50 req-1243a88f-e9eb-4e76-bfb7-72be0f80e77c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-cbc902c6-c96e-482b-836b-42016da98a50 req-1243a88f-e9eb-4e76-bfb7-72be0f80e77c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-cbc902c6-c96e-482b-836b-42016da98a50 req-1243a88f-e9eb-4e76-bfb7-72be0f80e77c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-cbc902c6-c96e-482b-836b-42016da98a50 req-1243a88f-e9eb-4e76-bfb7-72be0f80e77c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:53 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-cbc902c6-c96e-482b-836b-42016da98a50 req-1243a88f-e9eb-4e76-bfb7-72be0f80e77c service nova] Creating event network-changed:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:15:53 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-cbc902c6-c96e-482b-836b-42016da98a50 req-1243a88f-e9eb-4e76-bfb7-72be0f80e77c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036667 Apr 14 03:15:53 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 258/778] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-81864fe0-3ea1-4621-9a52-a668ef75f8fe req-bf50385c-87d8-4497-8f7b-a8b6878ce56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-81864fe0-3ea1-4621-9a52-a668ef75f8fe req-bf50385c-87d8-4497-8f7b-a8b6878ce56c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-81864fe0-3ea1-4621-9a52-a668ef75f8fe req-bf50385c-87d8-4497-8f7b-a8b6878ce56c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-81864fe0-3ea1-4621-9a52-a668ef75f8fe req-bf50385c-87d8-4497-8f7b-a8b6878ce56c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-81864fe0-3ea1-4621-9a52-a668ef75f8fe req-bf50385c-87d8-4497-8f7b-a8b6878ce56c service nova] Creating event network-vif-plugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:15:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-81864fe0-3ea1-4621-9a52-a668ef75f8fe req-bf50385c-87d8-4497-8f7b-a8b6878ce56c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036891 Apr 14 03:15:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 261/779] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-443b5deb-6c2b-4973-b237-a1160763f7c7 req-c91c607b-15c5-4cf8-be7f-511b8c78b1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-443b5deb-6c2b-4973-b237-a1160763f7c7 req-c91c607b-15c5-4cf8-be7f-511b8c78b1a6 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-443b5deb-6c2b-4973-b237-a1160763f7c7 req-c91c607b-15c5-4cf8-be7f-511b8c78b1a6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-443b5deb-6c2b-4973-b237-a1160763f7c7 req-c91c607b-15c5-4cf8-be7f-511b8c78b1a6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-443b5deb-6c2b-4973-b237-a1160763f7c7 req-c91c607b-15c5-4cf8-be7f-511b8c78b1a6 service nova] Creating event network-changed:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:15:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-443b5deb-6c2b-4973-b237-a1160763f7c7 req-c91c607b-15c5-4cf8-be7f-511b8c78b1a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037349 Apr 14 03:15:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 261/780] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:57 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-39db3312-2875-4b12-b78c-3caae6f2770a req-04cd8ffd-b206-4d61-8aad-ca6f23086365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}, {"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:15:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-39db3312-2875-4b12-b78c-3caae6f2770a req-04cd8ffd-b206-4d61-8aad-ca6f23086365 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-39db3312-2875-4b12-b78c-3caae6f2770a req-04cd8ffd-b206-4d61-8aad-ca6f23086365 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-39db3312-2875-4b12-b78c-3caae6f2770a req-04cd8ffd-b206-4d61-8aad-ca6f23086365 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:57 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-39db3312-2875-4b12-b78c-3caae6f2770a req-04cd8ffd-b206-4d61-8aad-ca6f23086365 service nova] Creating event network-vif-plugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:15:57 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-39db3312-2875-4b12-b78c-3caae6f2770a req-04cd8ffd-b206-4d61-8aad-ca6f23086365 service nova] Creating event network-vif-plugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:15:57 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-39db3312-2875-4b12-b78c-3caae6f2770a req-04cd8ffd-b206-4d61-8aad-ca6f23086365 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087317 Apr 14 03:15:57 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 259/781] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:15:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:15:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-80f70d52-e94a-4139-a502-c86db45dbb4c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:59 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-80f70d52-e94a-4139-a502-c86db45dbb4c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80f70d52-e94a-4139-a502-c86db45dbb4c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80f70d52-e94a-4139-a502-c86db45dbb4c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80f70d52-e94a-4139-a502-c86db45dbb4c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80f70d52-e94a-4139-a502-c86db45dbb4c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80f70d52-e94a-4139-a502-c86db45dbb4c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80f70d52-e94a-4139-a502-c86db45dbb4c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:59 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-80f70d52-e94a-4139-a502-c86db45dbb4c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lazy-loading 'services' on Instance uuid 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:15:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-80f70d52-e94a-4139-a502-c86db45dbb4c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments/d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e" status: 202 len: 0 microversion: 2.1 time: 0.180881 Apr 14 03:15:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 262/782] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:15:59 2023] DELETE /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments/d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:15:59 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c5b0d67e-5930-499f-9bdf-492c8f4d7aa7 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:15:59 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c5b0d67e-5930-499f-9bdf-492c8f4d7aa7 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:15:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c5b0d67e-5930-499f-9bdf-492c8f4d7aa7 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c5b0d67e-5930-499f-9bdf-492c8f4d7aa7 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c5b0d67e-5930-499f-9bdf-492c8f4d7aa7 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:15:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c5b0d67e-5930-499f-9bdf-492c8f4d7aa7 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:15:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c5b0d67e-5930-499f-9bdf-492c8f4d7aa7 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:15:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c5b0d67e-5930-499f-9bdf-492c8f4d7aa7 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c5b0d67e-5930-499f-9bdf-492c8f4d7aa7 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067532 Apr 14 03:16:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 262/783] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:15:59 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:09 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:09 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:09 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-ade1493a-b94e-408e-b8c2-5613c37c6c07 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:09 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-ade1493a-b94e-408e-b8c2-5613c37c6c07 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ade1493a-b94e-408e-b8c2-5613c37c6c07 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ade1493a-b94e-408e-b8c2-5613c37c6c07 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ade1493a-b94e-408e-b8c2-5613c37c6c07 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ade1493a-b94e-408e-b8c2-5613c37c6c07 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ade1493a-b94e-408e-b8c2-5613c37c6c07 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ade1493a-b94e-408e-b8c2-5613c37c6c07 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:09 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-ade1493a-b94e-408e-b8c2-5613c37c6c07 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.130988 Apr 14 03:16:09 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 260/784] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:16:09 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210/os-interface => generated 283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:10 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-4a34e80e-509d-4584-b905-68323d8d503b req-4caeb243-e93d-4a58-90f9-475704c03eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d1359d-2dcd-46d7-90f3-3801df9be357", "tag": "6ea4c00e-5d4b-4375-9b8d-60177a6ec526"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:10 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=14 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:10 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4a34e80e-509d-4584-b905-68323d8d503b req-4caeb243-e93d-4a58-90f9-475704c03eb7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4a34e80e-509d-4584-b905-68323d8d503b req-4caeb243-e93d-4a58-90f9-475704c03eb7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4a34e80e-509d-4584-b905-68323d8d503b req-4caeb243-e93d-4a58-90f9-475704c03eb7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-4a34e80e-509d-4584-b905-68323d8d503b req-4caeb243-e93d-4a58-90f9-475704c03eb7 service nova] Creating event network-changed:6ea4c00e-5d4b-4375-9b8d-60177a6ec526 for instance 24d1359d-2dcd-46d7-90f3-3801df9be357 on user Apr 14 03:16:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-4a34e80e-509d-4584-b905-68323d8d503b req-4caeb243-e93d-4a58-90f9-475704c03eb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041764 Apr 14 03:16:10 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 263/785] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:16:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4900a70d-39ca-44c8-9c5a-38fbd66e226f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4900a70d-39ca-44c8-9c5a-38fbd66e226f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=14 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4900a70d-39ca-44c8-9c5a-38fbd66e226f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4900a70d-39ca-44c8-9c5a-38fbd66e226f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4900a70d-39ca-44c8-9c5a-38fbd66e226f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4900a70d-39ca-44c8-9c5a-38fbd66e226f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4900a70d-39ca-44c8-9c5a-38fbd66e226f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4900a70d-39ca-44c8-9c5a-38fbd66e226f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:10 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4900a70d-39ca-44c8-9c5a-38fbd66e226f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:16:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4900a70d-39ca-44c8-9c5a-38fbd66e226f tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 200 len: 1427 microversion: 2.1 time: 0.354231 Apr 14 03:16:10 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 263/786] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:16:10 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 1427 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Old instance type m1.nano, new instance type m1.micro {{(pid=61662) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:10 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:11 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:16:11 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Getting quotas for user 7dea23743ba945c4a9d539b8e277c653 and project 4075885e26cb4adaad24d3ae6217fe35. Resources: {'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:16:11 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:16:11 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:16:11 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:16:11 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:16:11 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:16:11 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-776ea954-fcb1-4fd4-a43f-418774ad4286 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210/action" status: 202 len: 0 microversion: 2.1 time: 0.383719 Apr 14 03:16:11 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 261/787] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:16:10 2023] POST /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:16:11 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ea352970-5895-4ce6-9b63-ed9944d366bc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:11 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ea352970-5895-4ce6-9b63-ed9944d366bc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea352970-5895-4ce6-9b63-ed9944d366bc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea352970-5895-4ce6-9b63-ed9944d366bc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea352970-5895-4ce6-9b63-ed9944d366bc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea352970-5895-4ce6-9b63-ed9944d366bc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea352970-5895-4ce6-9b63-ed9944d366bc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea352970-5895-4ce6-9b63-ed9944d366bc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:11 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-ea352970-5895-4ce6-9b63-ed9944d366bc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:16:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ea352970-5895-4ce6-9b63-ed9944d366bc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 200 len: 1436 microversion: 2.1 time: 0.192504 Apr 14 03:16:11 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 264/788] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:16:11 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 1436 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:16:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-68b11a3f-c9a1-4c29-945e-f6d99de3dd72 req-dce8dc2c-9ffc-4aa5-9085-c8dc30c59bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-68b11a3f-c9a1-4c29-945e-f6d99de3dd72 req-dce8dc2c-9ffc-4aa5-9085-c8dc30c59bbd service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-68b11a3f-c9a1-4c29-945e-f6d99de3dd72 req-dce8dc2c-9ffc-4aa5-9085-c8dc30c59bbd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-68b11a3f-c9a1-4c29-945e-f6d99de3dd72 req-dce8dc2c-9ffc-4aa5-9085-c8dc30c59bbd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-68b11a3f-c9a1-4c29-945e-f6d99de3dd72 req-dce8dc2c-9ffc-4aa5-9085-c8dc30c59bbd service nova] Creating event network-changed:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:16:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-68b11a3f-c9a1-4c29-945e-f6d99de3dd72 req-dce8dc2c-9ffc-4aa5-9085-c8dc30c59bbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067136 Apr 14 03:16:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 264/789] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:16:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:16 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-e7f7c324-5517-49b2-8695-2daafe6f66b1 req-66f427e1-c6b6-4ddb-8fb0-25f31dd288f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "name": "network-vif-unplugged", "status": "completed", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e7f7c324-5517-49b2-8695-2daafe6f66b1 req-66f427e1-c6b6-4ddb-8fb0-25f31dd288f6 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e7f7c324-5517-49b2-8695-2daafe6f66b1 req-66f427e1-c6b6-4ddb-8fb0-25f31dd288f6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:16 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e7f7c324-5517-49b2-8695-2daafe6f66b1 req-66f427e1-c6b6-4ddb-8fb0-25f31dd288f6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:16 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-e7f7c324-5517-49b2-8695-2daafe6f66b1 req-66f427e1-c6b6-4ddb-8fb0-25f31dd288f6 service nova] Creating event network-vif-unplugged:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:16:16 user devstack@n-api.service[61662]: DEBUG nova.compute.api [req-e7f7c324-5517-49b2-8695-2daafe6f66b1 req-66f427e1-c6b6-4ddb-8fb0-25f31dd288f6 service nova] Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61662) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:16:16 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-e7f7c324-5517-49b2-8695-2daafe6f66b1 req-66f427e1-c6b6-4ddb-8fb0-25f31dd288f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118578 Apr 14 03:16:16 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 262/790] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:16:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-deeca419-4bf3-4e52-986c-38b6ec9790fd req-8a723668-0910-4ea6-b5ee-f9fa1c6f37ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "name": "network-vif-plugged", "status": "completed", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-deeca419-4bf3-4e52-986c-38b6ec9790fd req-8a723668-0910-4ea6-b5ee-f9fa1c6f37ca service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-deeca419-4bf3-4e52-986c-38b6ec9790fd req-8a723668-0910-4ea6-b5ee-f9fa1c6f37ca service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-deeca419-4bf3-4e52-986c-38b6ec9790fd req-8a723668-0910-4ea6-b5ee-f9fa1c6f37ca service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-deeca419-4bf3-4e52-986c-38b6ec9790fd req-8a723668-0910-4ea6-b5ee-f9fa1c6f37ca service nova] Creating event network-vif-plugged:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:16:18 user devstack@n-api.service[61664]: DEBUG nova.compute.api [req-deeca419-4bf3-4e52-986c-38b6ec9790fd req-8a723668-0910-4ea6-b5ee-f9fa1c6f37ca service nova] Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61664) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:16:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-deeca419-4bf3-4e52-986c-38b6ec9790fd req-8a723668-0910-4ea6-b5ee-f9fa1c6f37ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060425 Apr 14 03:16:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 265/791] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:16:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-53e2dc12-049d-4b69-9624-055d130919eb tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-53e2dc12-049d-4b69-9624-055d130919eb tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-53e2dc12-049d-4b69-9624-055d130919eb tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-53e2dc12-049d-4b69-9624-055d130919eb tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-53e2dc12-049d-4b69-9624-055d130919eb tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-53e2dc12-049d-4b69-9624-055d130919eb tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-53e2dc12-049d-4b69-9624-055d130919eb tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-53e2dc12-049d-4b69-9624-055d130919eb tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:25 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-53e2dc12-049d-4b69-9624-055d130919eb tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lazy-loading 'services' on Instance uuid 8a67985b-1938-4b7d-b486-13f6811611f3 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:16:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-53e2dc12-049d-4b69-9624-055d130919eb tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-volume_attachments/7fff5d89-4516-4be1-9698-f088498889ff" status: 202 len: 0 microversion: 2.1 time: 0.235719 Apr 14 03:16:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 265/792] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:16:25 2023] DELETE /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-volume_attachments/7fff5d89-4516-4be1-9698-f088498889ff => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:16:25 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:25 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-ba12ee61-6719-4b9c-a73b-469094f0299f tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:25 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-ba12ee61-6719-4b9c-a73b-469094f0299f tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ba12ee61-6719-4b9c-a73b-469094f0299f tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ba12ee61-6719-4b9c-a73b-469094f0299f tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ba12ee61-6719-4b9c-a73b-469094f0299f tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ba12ee61-6719-4b9c-a73b-469094f0299f tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ba12ee61-6719-4b9c-a73b-469094f0299f tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-ba12ee61-6719-4b9c-a73b-469094f0299f tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:25 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-ba12ee61-6719-4b9c-a73b-469094f0299f tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061918 Apr 14 03:16:25 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 263/793] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:16:25 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:28 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-69f1326d-98d3-4845-abaa-3cdcb7a49423 req-cf3b2ee6-b486-4634-b6b2-f20cda39aa31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "name": "network-vif-plugged", "status": "completed", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-69f1326d-98d3-4845-abaa-3cdcb7a49423 req-cf3b2ee6-b486-4634-b6b2-f20cda39aa31 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-69f1326d-98d3-4845-abaa-3cdcb7a49423 req-cf3b2ee6-b486-4634-b6b2-f20cda39aa31 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-69f1326d-98d3-4845-abaa-3cdcb7a49423 req-cf3b2ee6-b486-4634-b6b2-f20cda39aa31 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:28 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-69f1326d-98d3-4845-abaa-3cdcb7a49423 req-cf3b2ee6-b486-4634-b6b2-f20cda39aa31 service nova] Creating event network-vif-plugged:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:16:28 user devstack@n-api.service[61664]: DEBUG nova.compute.api [req-69f1326d-98d3-4845-abaa-3cdcb7a49423 req-cf3b2ee6-b486-4634-b6b2-f20cda39aa31 service nova] Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61664) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:16:28 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-69f1326d-98d3-4845-abaa-3cdcb7a49423 req-cf3b2ee6-b486-4634-b6b2-f20cda39aa31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045989 Apr 14 03:16:28 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 266/794] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:16:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-604221994", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "98e6a247-250b-4bb5-a947-e7f93598d16e", "destination_type": "volume"}], "networks": [{"uuid": "de8764bb-1ca4-4c30-8dee-bce850658327"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] validate_networks() for [('de8764bb-1ca4-4c30-8dee-bce850658327', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Getting quotas for project bd2c5b2aafaf4ca7bf62e988ac726658. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Getting quotas for user d666936eb0ee43a2ad9e17a12e6e273d and project bd2c5b2aafaf4ca7bf62e988ac726658. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:16:29 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:16:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-076fc63b-a749-44f2-93ec-0f5c9b727ece tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.799982 Apr 14 03:16:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 266/795] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 03:16:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 03:16:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-9a76dd40-09a4-469e-b7ff-f71ad336ef76 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:29 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-9a76dd40-09a4-469e-b7ff-f71ad336ef76 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:29 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-9a76dd40-09a4-469e-b7ff-f71ad336ef76 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:16:29 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-9a76dd40-09a4-469e-b7ff-f71ad336ef76 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:16:29 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-9a76dd40-09a4-469e-b7ff-f71ad336ef76 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:16:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-9a76dd40-09a4-469e-b7ff-f71ad336ef76 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81" status: 200 len: 1394 microversion: 2.87 time: 0.083273 Apr 14 03:16:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 264/796] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:16:29 2023] GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81 => generated 1394 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 03:16:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-1fe8be52-2108-4945-abc4-a16fe399ebe9 req-3037b1de-9263-4c24-ac11-d0385f93c3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "name": "network-vif-plugged", "status": "completed", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1fe8be52-2108-4945-abc4-a16fe399ebe9 req-3037b1de-9263-4c24-ac11-d0385f93c3b6 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1fe8be52-2108-4945-abc4-a16fe399ebe9 req-3037b1de-9263-4c24-ac11-d0385f93c3b6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1fe8be52-2108-4945-abc4-a16fe399ebe9 req-3037b1de-9263-4c24-ac11-d0385f93c3b6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1fe8be52-2108-4945-abc4-a16fe399ebe9 req-3037b1de-9263-4c24-ac11-d0385f93c3b6 service nova] Creating event network-vif-plugged:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:16:30 user devstack@n-api.service[61664]: DEBUG nova.compute.api [req-1fe8be52-2108-4945-abc4-a16fe399ebe9 req-3037b1de-9263-4c24-ac11-d0385f93c3b6 service nova] Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61664) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 03:16:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-1fe8be52-2108-4945-abc4-a16fe399ebe9 req-3037b1de-9263-4c24-ac11-d0385f93c3b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046110 Apr 14 03:16:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 267/797] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:16:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a85d9fff-5c23-4d39-b4d4-3ebf399a572b req-de500549-eb84-4247-af30-9e4065c9cad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a85d9fff-5c23-4d39-b4d4-3ebf399a572b req-de500549-eb84-4247-af30-9e4065c9cad9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a85d9fff-5c23-4d39-b4d4-3ebf399a572b req-de500549-eb84-4247-af30-9e4065c9cad9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a85d9fff-5c23-4d39-b4d4-3ebf399a572b req-de500549-eb84-4247-af30-9e4065c9cad9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a85d9fff-5c23-4d39-b4d4-3ebf399a572b req-de500549-eb84-4247-af30-9e4065c9cad9 service nova] Creating event network-changed:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:16:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a85d9fff-5c23-4d39-b4d4-3ebf399a572b req-de500549-eb84-4247-af30-9e4065c9cad9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068115 Apr 14 03:16:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 267/798] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:16:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:34 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:34 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7f542934-641f-405f-811c-3601a3be389b] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance 7f542934-641f-405f-811c-3601a3be389b could not be found. Apr 14 03:16:34 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:16:34 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b HTTP/1.1 Apr 14 03:16:34 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:16:34 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:16:34 user devstack@n-api.service[61662]: Connection: close Apr 14 03:16:34 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:16:34 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:16:34 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:16:34 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:16:34 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:16:34 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:16:34 user devstack@n-api.service[61662]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:16:34 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:16:34 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:16:34 user devstack@n-api.service[61662]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:16:34 user devstack@n-api.service[61662]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:16:34 user devstack@n-api.service[61662]: method: > Apr 14 03:16:34 user devstack@n-api.service[61662]: exception: Instance 7f542934-641f-405f-811c-3601a3be389b could not be found. Apr 14 03:16:34 user devstack@n-api.service[61662]: action_args: {'id': '7f542934-641f-405f-811c-3601a3be389b'} Apr 14 03:16:34 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f542934-641f-405f-811c-3601a3be389b could not be found. Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f542934-641f-405f-811c-3601a3be389b could not be found. Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f542934-641f-405f-811c-3601a3be389b could not be found. Apr 14 03:16:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:16:34 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance 7f542934-641f-405f-811c-3601a3be389b could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:16:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-38f7fddc-ce30-43f7-80b9-7601aa8e1870 tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b" status: 404 len: 111 microversion: 2.1 time: 0.061298 Apr 14 03:16:34 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 265/799] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:16:34 2023] GET /compute/v2.1/servers/7f542934-641f-405f-811c-3601a3be389b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:16:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7a1e2563-0dc3-4cc9-aa61-7cb321f28622] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:16:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:16:35 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 HTTP/1.1 Apr 14 03:16:35 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:16:35 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:16:35 user devstack@n-api.service[61664]: Connection: close Apr 14 03:16:35 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:16:35 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:16:35 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:16:35 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:16:35 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:16:35 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:16:35 user devstack@n-api.service[61664]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:16:35 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:16:35 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:16:35 user devstack@n-api.service[61664]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:16:35 user devstack@n-api.service[61664]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:16:35 user devstack@n-api.service[61664]: method: > Apr 14 03:16:35 user devstack@n-api.service[61664]: exception: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:16:35 user devstack@n-api.service[61664]: action_args: {'id': '7a1e2563-0dc3-4cc9-aa61-7cb321f28622'} Apr 14 03:16:35 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:16:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:16:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:16:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-39e79c96-4a3a-43d6-a146-9fbb133d3d8d tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622" status: 404 len: 111 microversion: 2.1 time: 0.033751 Apr 14 03:16:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 268/800] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:16:35 2023] DELETE /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:16:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:35 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] [instance: 7a1e2563-0dc3-4cc9-aa61-7cb321f28622] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] HTTP exception thrown: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:16:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Request method failure captured: Apr 14 03:16:35 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 HTTP/1.1 Apr 14 03:16:35 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:16:35 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:16:35 user devstack@n-api.service[61663]: Connection: close Apr 14 03:16:35 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:16:35 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:16:35 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:16:35 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:16:35 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMGJgLODf4NJ9SOgXRtgo2fIdQy43Foy7919YSnX4WVmn2-rfDUcb0xgpLLLCsa6u55jypaXP2GYycoBv_8aR1ERayW9uj2LYpaHdA-2mR9VWb7Hp1dY4t4Um2F7TYQqCKXaVrxddOtcwBSpfcCQItTGxJncyvOaB-1-oK28d32KfQk Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Project-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d2e49e8e92e416faebf55e3d4e0e087"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d2e49e8e92e416faebf55e3d4e0e087"}]}] Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Tenant: tempest-TestVolumeBootPattern-910285030 Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Tenant-Id: 2d2e49e8e92e416faebf55e3d4e0e087 Apr 14 03:16:35 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestVolumeBootPattern-910285030 Apr 14 03:16:35 user devstack@n-api.service[61663]: X-User: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:16:35 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:16:35 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:16:35 user devstack@n-api.service[61663]: X-User-Id: 60e11b7ab2914209b23bf7a53791da64 Apr 14 03:16:35 user devstack@n-api.service[61663]: X-User-Name: tempest-TestVolumeBootPattern-910285030-project-member Apr 14 03:16:35 user devstack@n-api.service[61663]: method: > Apr 14 03:16:35 user devstack@n-api.service[61663]: exception: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:16:35 user devstack@n-api.service[61663]: action_args: {'id': '7a1e2563-0dc3-4cc9-aa61-7cb321f28622'} Apr 14 03:16:35 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. Apr 14 03:16:35 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:16:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Returning 404 to user: Instance 7a1e2563-0dc3-4cc9-aa61-7cb321f28622 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:16:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a75c63ce-c368-407f-aee5-c4f9bf72946c tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622" status: 404 len: 111 microversion: 2.1 time: 0.039880 Apr 14 03:16:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 268/801] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:16:35 2023] GET /compute/v2.1/servers/7a1e2563-0dc3-4cc9-aa61-7cb321f28622 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:16:38 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-131a0b2e-184a-410e-ac88-d975e77fbfdf tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] Calling method '.version_select at 0x7ff11a3e13f0>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-131a0b2e-184a-410e-ac88-d975e77fbfdf tempest-TestVolumeBootPattern-910285030 tempest-TestVolumeBootPattern-910285030-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-742486677" status: 202 len: 0 microversion: 2.1 time: 0.030411 Apr 14 03:16:38 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 266/802] 10.0.0.210 () {62 vars in 1337 bytes} [Fri Apr 14 03:16:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-742486677 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:16:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e8af2e7f-e262-43b8-9740-7470acc6d558 req-acdb79f3-e8a1-4fed-8af1-9a47784cf9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-plugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:45 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=13 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e8af2e7f-e262-43b8-9740-7470acc6d558 req-acdb79f3-e8a1-4fed-8af1-9a47784cf9c0 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e8af2e7f-e262-43b8-9740-7470acc6d558 req-acdb79f3-e8a1-4fed-8af1-9a47784cf9c0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e8af2e7f-e262-43b8-9740-7470acc6d558 req-acdb79f3-e8a1-4fed-8af1-9a47784cf9c0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:45 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=23 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e8af2e7f-e262-43b8-9740-7470acc6d558 req-acdb79f3-e8a1-4fed-8af1-9a47784cf9c0 service nova] Creating event network-vif-plugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:16:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e8af2e7f-e262-43b8-9740-7470acc6d558 req-acdb79f3-e8a1-4fed-8af1-9a47784cf9c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035231 Apr 14 03:16:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 269/803] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:16:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:16:47 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-b13e7657-4a9f-4958-a7fb-7e7d8159fcaa req-868bdd3c-88b8-4d72-8d5b-c41e975de0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-plugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:47 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:47 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:47 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:47 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b13e7657-4a9f-4958-a7fb-7e7d8159fcaa req-868bdd3c-88b8-4d72-8d5b-c41e975de0d1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b13e7657-4a9f-4958-a7fb-7e7d8159fcaa req-868bdd3c-88b8-4d72-8d5b-c41e975de0d1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b13e7657-4a9f-4958-a7fb-7e7d8159fcaa req-868bdd3c-88b8-4d72-8d5b-c41e975de0d1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-b13e7657-4a9f-4958-a7fb-7e7d8159fcaa req-868bdd3c-88b8-4d72-8d5b-c41e975de0d1 service nova] Creating event network-vif-plugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:16:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-b13e7657-4a9f-4958-a7fb-7e7d8159fcaa req-868bdd3c-88b8-4d72-8d5b-c41e975de0d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051049 Apr 14 03:16:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 269/804] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:16:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f856eb66-e2dd-4c97-b3ae-472d0b07b270 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-f856eb66-e2dd-4c97-b3ae-472d0b07b270 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f856eb66-e2dd-4c97-b3ae-472d0b07b270 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f856eb66-e2dd-4c97-b3ae-472d0b07b270 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f856eb66-e2dd-4c97-b3ae-472d0b07b270 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f856eb66-e2dd-4c97-b3ae-472d0b07b270 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f856eb66-e2dd-4c97-b3ae-472d0b07b270 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f856eb66-e2dd-4c97-b3ae-472d0b07b270 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f856eb66-e2dd-4c97-b3ae-472d0b07b270 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069107 Apr 14 03:16:50 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 267/805] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:16:50 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:16:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-14a668f1-51a5-4155-9442-ca06617a474c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "972ac1b0-8c90-4a59-a53a-92321048d947"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:16:54 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-14a668f1-51a5-4155-9442-ca06617a474c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:16:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-14a668f1-51a5-4155-9442-ca06617a474c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-14a668f1-51a5-4155-9442-ca06617a474c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-14a668f1-51a5-4155-9442-ca06617a474c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-14a668f1-51a5-4155-9442-ca06617a474c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:16:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-14a668f1-51a5-4155-9442-ca06617a474c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:16:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-14a668f1-51a5-4155-9442-ca06617a474c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:16:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-14a668f1-51a5-4155-9442-ca06617a474c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328241 Apr 14 03:16:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 270/806] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:16:54 2023] POST /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4141545b-54ec-4709-ab87-afe27852b2de tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4141545b-54ec-4709-ab87-afe27852b2de tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4141545b-54ec-4709-ab87-afe27852b2de tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4141545b-54ec-4709-ab87-afe27852b2de tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4141545b-54ec-4709-ab87-afe27852b2de tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4141545b-54ec-4709-ab87-afe27852b2de tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4141545b-54ec-4709-ab87-afe27852b2de tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4141545b-54ec-4709-ab87-afe27852b2de tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:01 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4141545b-54ec-4709-ab87-afe27852b2de tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:17:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4141545b-54ec-4709-ab87-afe27852b2de tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 200 len: 1553 microversion: 2.1 time: 0.537794 Apr 14 03:17:01 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 270/807] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:17:01 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 1553 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-442e2f08-8fb3-46db-9b74-7587defb548b tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-442e2f08-8fb3-46db-9b74-7587defb548b tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-442e2f08-8fb3-46db-9b74-7587defb548b tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-442e2f08-8fb3-46db-9b74-7587defb548b tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-442e2f08-8fb3-46db-9b74-7587defb548b tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-442e2f08-8fb3-46db-9b74-7587defb548b tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-442e2f08-8fb3-46db-9b74-7587defb548b tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-442e2f08-8fb3-46db-9b74-7587defb548b tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:04 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-442e2f08-8fb3-46db-9b74-7587defb548b tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lazy-loading 'services' on Instance uuid 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:17:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-442e2f08-8fb3-46db-9b74-7587defb548b tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments/972ac1b0-8c90-4a59-a53a-92321048d947" status: 202 len: 0 microversion: 2.1 time: 0.176587 Apr 14 03:17:04 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 268/808] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:17:04 2023] DELETE /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments/972ac1b0-8c90-4a59-a53a-92321048d947 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:17:04 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:04 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e65a6b49-1ece-4f94-a5b3-f7831164f4b1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:17:04 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e65a6b49-1ece-4f94-a5b3-f7831164f4b1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:17:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e65a6b49-1ece-4f94-a5b3-f7831164f4b1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e65a6b49-1ece-4f94-a5b3-f7831164f4b1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e65a6b49-1ece-4f94-a5b3-f7831164f4b1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e65a6b49-1ece-4f94-a5b3-f7831164f4b1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e65a6b49-1ece-4f94-a5b3-f7831164f4b1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e65a6b49-1ece-4f94-a5b3-f7831164f4b1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e65a6b49-1ece-4f94-a5b3-f7831164f4b1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051591 Apr 14 03:17:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 271/809] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:17:04 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:17:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-02ae230f-4f83-444a-9dca-d7c7ec4bee08 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:17:15 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-02ae230f-4f83-444a-9dca-d7c7ec4bee08 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:17:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-02ae230f-4f83-444a-9dca-d7c7ec4bee08 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-02ae230f-4f83-444a-9dca-d7c7ec4bee08 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-02ae230f-4f83-444a-9dca-d7c7ec4bee08 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-02ae230f-4f83-444a-9dca-d7c7ec4bee08 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-02ae230f-4f83-444a-9dca-d7c7ec4bee08 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-02ae230f-4f83-444a-9dca-d7c7ec4bee08 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-02ae230f-4f83-444a-9dca-d7c7ec4bee08 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049635 Apr 14 03:17:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 271/810] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:17:15 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:17:19 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:19 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:19 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-14325a81-9510-4445-97dd-c20915c9550c tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '.version_select at 0x7ff11a19f1c0>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:17:19 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-14325a81-9510-4445-97dd-c20915c9550c tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/b96871c7-2eee-43a3-82b5-3a0299fdd7a8" status: 204 len: 0 microversion: 2.1 time: 0.197493 Apr 14 03:17:19 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 269/811] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:17:19 2023] DELETE /compute/v2.1/images/b96871c7-2eee-43a3-82b5-3a0299fdd7a8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-54c09ed6-dc78-4d7e-bd0f-66718d5b7f4b tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-54c09ed6-dc78-4d7e-bd0f-66718d5b7f4b tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-54c09ed6-dc78-4d7e-bd0f-66718d5b7f4b tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-54c09ed6-dc78-4d7e-bd0f-66718d5b7f4b tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-54c09ed6-dc78-4d7e-bd0f-66718d5b7f4b tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-54c09ed6-dc78-4d7e-bd0f-66718d5b7f4b tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-54c09ed6-dc78-4d7e-bd0f-66718d5b7f4b tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-54c09ed6-dc78-4d7e-bd0f-66718d5b7f4b tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-54c09ed6-dc78-4d7e-bd0f-66718d5b7f4b tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:17:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-54c09ed6-dc78-4d7e-bd0f-66718d5b7f4b tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3" status: 204 len: 0 microversion: 2.1 time: 0.170227 Apr 14 03:17:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 272/812] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:17:19 2023] DELETE /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:17:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3b9b4743-d1f1-4551-bd6d-85f785f0acd3 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:17:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3b9b4743-d1f1-4551-bd6d-85f785f0acd3 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:17:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9b4743-d1f1-4551-bd6d-85f785f0acd3 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9b4743-d1f1-4551-bd6d-85f785f0acd3 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9b4743-d1f1-4551-bd6d-85f785f0acd3 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9b4743-d1f1-4551-bd6d-85f785f0acd3 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9b4743-d1f1-4551-bd6d-85f785f0acd3 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9b4743-d1f1-4551-bd6d-85f785f0acd3 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:19 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-3b9b4743-d1f1-4551-bd6d-85f785f0acd3 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c683fe5636b49858857033797ff8e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb4fbf55f04294a3d97800142bdca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:17:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3b9b4743-d1f1-4551-bd6d-85f785f0acd3 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3" status: 200 len: 1679 microversion: 2.1 time: 0.255082 Apr 14 03:17:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 272/813] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:17:19 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3 => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:17:19 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-0232379d-d057-42c0-ab3f-39f8878de445 req-ca3c2216-2562-442b-b54a-1d5c4eaa65d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-unplugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:17:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0232379d-d057-42c0-ab3f-39f8878de445 req-ca3c2216-2562-442b-b54a-1d5c4eaa65d2 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0232379d-d057-42c0-ab3f-39f8878de445 req-ca3c2216-2562-442b-b54a-1d5c4eaa65d2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0232379d-d057-42c0-ab3f-39f8878de445 req-ca3c2216-2562-442b-b54a-1d5c4eaa65d2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:19 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-0232379d-d057-42c0-ab3f-39f8878de445 req-ca3c2216-2562-442b-b54a-1d5c4eaa65d2 service nova] Creating event network-vif-unplugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:17:19 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-0232379d-d057-42c0-ab3f-39f8878de445 req-ca3c2216-2562-442b-b54a-1d5c4eaa65d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030499 Apr 14 03:17:19 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 270/814] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:17:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:20 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:17:20 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:17:20 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:17:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2979f968-daf6-4948-8659-b12cc7d4cbfd tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81" status: 200 len: 1769 microversion: 2.87 time: 0.283635 Apr 14 03:17:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 273/815] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:17:19 2023] GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81 => generated 1769 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:17:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ae9697a7-fc41-4382-b543-9e6647680155 req-338b462a-f977-4c15-bed0-96168efac5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-deleted", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:17:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ae9697a7-fc41-4382-b543-9e6647680155 req-338b462a-f977-4c15-bed0-96168efac5e3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ae9697a7-fc41-4382-b543-9e6647680155 req-338b462a-f977-4c15-bed0-96168efac5e3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ae9697a7-fc41-4382-b543-9e6647680155 req-338b462a-f977-4c15-bed0-96168efac5e3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ae9697a7-fc41-4382-b543-9e6647680155 req-338b462a-f977-4c15-bed0-96168efac5e3 service nova] Creating event network-vif-deleted:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:17:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ae9697a7-fc41-4382-b543-9e6647680155 req-338b462a-f977-4c15-bed0-96168efac5e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031097 Apr 14 03:17:21 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 273/816] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:17:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:17:21 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-06697d97-9ff9-4e61-9d95-5d515a6d304d req-70dba5ab-0b70-465b-9dc9-eb0a6a6b0c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67985b-1938-4b7d-b486-13f6811611f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d081ef4-9756-4571-b28c-0d4582c58f0a"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:17:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-06697d97-9ff9-4e61-9d95-5d515a6d304d req-70dba5ab-0b70-465b-9dc9-eb0a6a6b0c6f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-06697d97-9ff9-4e61-9d95-5d515a6d304d req-70dba5ab-0b70-465b-9dc9-eb0a6a6b0c6f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-06697d97-9ff9-4e61-9d95-5d515a6d304d req-70dba5ab-0b70-465b-9dc9-eb0a6a6b0c6f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-06697d97-9ff9-4e61-9d95-5d515a6d304d req-70dba5ab-0b70-465b-9dc9-eb0a6a6b0c6f service nova] Creating event network-vif-plugged:2d081ef4-9756-4571-b28c-0d4582c58f0a for instance 8a67985b-1938-4b7d-b486-13f6811611f3 on user Apr 14 03:17:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-06697d97-9ff9-4e61-9d95-5d515a6d304d req-70dba5ab-0b70-465b-9dc9-eb0a6a6b0c6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029529 Apr 14 03:17:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 271/817] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:17:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:17:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-52f2b6f6-7f92-449e-9ac4-eba5d4ef6703 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'create', calling method: .version_select at 0x7ff11a3de3b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-38758631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLpvRH/iiMHYTrjdAzOT7swMWulL8zixU7ppruKTH3LsxMEI1RMZv3PNx+fzQlWx2Y295WnVKwNn+mPfk5MJDyTHw+kzZIW87C2e8Z/iARwbfZzvewxzYpvwTsj4RrU0g=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:17:46 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:46 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:46 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-52f2b6f6-7f92-449e-9ac4-eba5d4ef6703 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Getting quotas for project 0bd451b3f6734fe3ac0a8e8a853bb9eb. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:17:46 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-52f2b6f6-7f92-449e-9ac4-eba5d4ef6703 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Getting quotas for user 12199a43298942898a2e694ee2c5230e and project 0bd451b3f6734fe3ac0a8e8a853bb9eb. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:17:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-52f2b6f6-7f92-449e-9ac4-eba5d4ef6703 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.080446 Apr 14 03:17:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 274/818] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:17:46 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:17:46 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:46 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=14 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-252373748", "imageRef": "3af87ed2-d2c6-4608-b72f-8b0f91e4ca86", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-38758631", "networks": [{"uuid": "3b75178e-4dcf-4cc1-b910-443fadcadac4"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:17:46 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] validate_networks() for [('3b75178e-4dcf-4cc1-b910-443fadcadac4', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Getting quotas for project 0bd451b3f6734fe3ac0a8e8a853bb9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Getting quotas for user 12199a43298942898a2e694ee2c5230e and project 0bd451b3f6734fe3ac0a8e8a853bb9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:17:47 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3af87ed2-d2c6-4608-b72f-8b0f91e4ca86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:17:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7fda8bd9-36f3-495b-bb29-f9e78f939444 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.543425 Apr 14 03:17:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 274/819] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:17:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:17:47 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:47 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:47 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-34f04264-9871-4ccf-b643-b335064c0a7b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:17:47 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-34f04264-9871-4ccf-b643-b335064c0a7b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:17:47 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-34f04264-9871-4ccf-b643-b335064c0a7b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:17:47 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-34f04264-9871-4ccf-b643-b335064c0a7b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 200 len: 1250 microversion: 2.1 time: 0.071477 Apr 14 03:17:47 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 272/820] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:17:47 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 1250 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:17:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-da0fc2b0-f30e-44f0-861a-21463be5d18b req-4df353fc-08fd-4035-a7d4-6e9de4795dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:17:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-da0fc2b0-f30e-44f0-861a-21463be5d18b req-4df353fc-08fd-4035-a7d4-6e9de4795dd3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-da0fc2b0-f30e-44f0-861a-21463be5d18b req-4df353fc-08fd-4035-a7d4-6e9de4795dd3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-da0fc2b0-f30e-44f0-861a-21463be5d18b req-4df353fc-08fd-4035-a7d4-6e9de4795dd3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-da0fc2b0-f30e-44f0-861a-21463be5d18b req-4df353fc-08fd-4035-a7d4-6e9de4795dd3 service nova] Creating event network-changed:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:17:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-da0fc2b0-f30e-44f0-861a-21463be5d18b req-4df353fc-08fd-4035-a7d4-6e9de4795dd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032914 Apr 14 03:17:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 275/821] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:17:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c727691b-3448-4368-8fb9-f7939935d72a req-ce943d89-7b01-4695-a23a-d25557326178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "name": "network-vif-plugged", "status": "completed", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:17:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c727691b-3448-4368-8fb9-f7939935d72a req-ce943d89-7b01-4695-a23a-d25557326178 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c727691b-3448-4368-8fb9-f7939935d72a req-ce943d89-7b01-4695-a23a-d25557326178 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c727691b-3448-4368-8fb9-f7939935d72a req-ce943d89-7b01-4695-a23a-d25557326178 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c727691b-3448-4368-8fb9-f7939935d72a req-ce943d89-7b01-4695-a23a-d25557326178 service nova] Creating event network-vif-plugged:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:17:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c727691b-3448-4368-8fb9-f7939935d72a req-ce943d89-7b01-4695-a23a-d25557326178 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037300 Apr 14 03:17:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 275/822] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:17:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:17:54 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-874c23be-0821-4528-a9d8-2fa6fe4bc17c req-f7552ff4-b300-476d-abb0-9c185f16bd9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "name": "network-vif-plugged", "status": "completed", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:17:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-874c23be-0821-4528-a9d8-2fa6fe4bc17c req-f7552ff4-b300-476d-abb0-9c185f16bd9e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-874c23be-0821-4528-a9d8-2fa6fe4bc17c req-f7552ff4-b300-476d-abb0-9c185f16bd9e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-874c23be-0821-4528-a9d8-2fa6fe4bc17c req-f7552ff4-b300-476d-abb0-9c185f16bd9e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:54 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-874c23be-0821-4528-a9d8-2fa6fe4bc17c req-f7552ff4-b300-476d-abb0-9c185f16bd9e service nova] Creating event network-vif-plugged:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:17:54 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-874c23be-0821-4528-a9d8-2fa6fe4bc17c req-f7552ff4-b300-476d-abb0-9c185f16bd9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033458 Apr 14 03:17:54 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 273/823] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:17:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:17:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-19f97f86-91c8-4eac-804e-da8564156d25 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:17:54 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-19f97f86-91c8-4eac-804e-da8564156d25 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:17:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19f97f86-91c8-4eac-804e-da8564156d25 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19f97f86-91c8-4eac-804e-da8564156d25 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19f97f86-91c8-4eac-804e-da8564156d25 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19f97f86-91c8-4eac-804e-da8564156d25 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19f97f86-91c8-4eac-804e-da8564156d25 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19f97f86-91c8-4eac-804e-da8564156d25 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-19f97f86-91c8-4eac-804e-da8564156d25 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048724 Apr 14 03:17:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 276/824] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:17:54 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:17:58 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:58 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9d830c5-2948-4289-9100-8665b806d340"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:17:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:17:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:17:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:17:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:17:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301559 Apr 14 03:17:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 276/825] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:17:58 2023] POST /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:18:02 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:02 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-dcfaa72b-88d2-492c-a855-c0a8c362047c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:02 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-dcfaa72b-88d2-492c-a855-c0a8c362047c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dcfaa72b-88d2-492c-a855-c0a8c362047c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dcfaa72b-88d2-492c-a855-c0a8c362047c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dcfaa72b-88d2-492c-a855-c0a8c362047c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dcfaa72b-88d2-492c-a855-c0a8c362047c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dcfaa72b-88d2-492c-a855-c0a8c362047c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:02 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dcfaa72b-88d2-492c-a855-c0a8c362047c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:02 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-dcfaa72b-88d2-492c-a855-c0a8c362047c tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210/action" status: 204 len: 0 microversion: 2.1 time: 0.078975 Apr 14 03:18:02 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 274/826] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:18:02 2023] POST /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:18:02 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:02 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d91cbb9b-036e-47c4-af51-bf48bfafe1db tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:18:02 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d91cbb9b-036e-47c4-af51-bf48bfafe1db tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d91cbb9b-036e-47c4-af51-bf48bfafe1db tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d91cbb9b-036e-47c4-af51-bf48bfafe1db tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d91cbb9b-036e-47c4-af51-bf48bfafe1db tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d91cbb9b-036e-47c4-af51-bf48bfafe1db tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d91cbb9b-036e-47c4-af51-bf48bfafe1db tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d91cbb9b-036e-47c4-af51-bf48bfafe1db tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:02 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-d91cbb9b-036e-47c4-af51-bf48bfafe1db tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:18:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d91cbb9b-036e-47c4-af51-bf48bfafe1db tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 200 len: 1553 microversion: 2.1 time: 0.271142 Apr 14 03:18:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 277/827] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:18:02 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 1553 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:18:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4daf2b34-8ce5-4142-bc76-590d30180088 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:18:06 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4daf2b34-8ce5-4142-bc76-590d30180088 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4daf2b34-8ce5-4142-bc76-590d30180088 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4daf2b34-8ce5-4142-bc76-590d30180088 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4daf2b34-8ce5-4142-bc76-590d30180088 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4daf2b34-8ce5-4142-bc76-590d30180088 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4daf2b34-8ce5-4142-bc76-590d30180088 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4daf2b34-8ce5-4142-bc76-590d30180088 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:07 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-4daf2b34-8ce5-4142-bc76-590d30180088 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lazy-loading 'services' on Instance uuid 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:18:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4daf2b34-8ce5-4142-bc76-590d30180088 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments/e9d830c5-2948-4289-9100-8665b806d340" status: 202 len: 0 microversion: 2.1 time: 0.418258 Apr 14 03:18:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 277/828] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:18:06 2023] DELETE /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments/e9d830c5-2948-4289-9100-8665b806d340 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:18:07 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-89b9693c-520f-49ed-a092-37ecd85da471 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:18:07 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-89b9693c-520f-49ed-a092-37ecd85da471 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-89b9693c-520f-49ed-a092-37ecd85da471 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-89b9693c-520f-49ed-a092-37ecd85da471 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-89b9693c-520f-49ed-a092-37ecd85da471 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-89b9693c-520f-49ed-a092-37ecd85da471 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-89b9693c-520f-49ed-a092-37ecd85da471 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-89b9693c-520f-49ed-a092-37ecd85da471 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:07 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-89b9693c-520f-49ed-a092-37ecd85da471 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049872 Apr 14 03:18:07 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 275/829] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:18:07 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:18:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:18:09 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] [instance: 8a67985b-1938-4b7d-b486-13f6811611f3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] HTTP exception thrown: Instance 8a67985b-1938-4b7d-b486-13f6811611f3 could not be found. Apr 14 03:18:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Request method failure captured: Apr 14 03:18:09 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3 HTTP/1.1 Apr 14 03:18:09 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:18:09 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:18:09 user devstack@n-api.service[61664]: Connection: close Apr 14 03:18:09 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:18:09 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:18:09 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:18:09 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:18:09 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMQMv6nytOuVpFXRo26lFn5_CISSPStm78t1lTIGtWYlgm3VaUVX6gBYfA0rSAwhMHgXPZWsZN-mGl3o2c6vo9QYs5AsNoJ8WwkVjT_qZ3tg4BJg_ASm5dsbA3UdS2d34Af9BO4K5D-xXqHt9pw9AVVnT0bUvYpawSkmmdT0177Z87E Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Project-Id: 82eb4fbf55f04294a3d97800142bdca9 Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1642713032 Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/82eb4fbf55f04294a3d97800142bdca9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/82eb4fbf55f04294a3d97800142bdca9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/82eb4fbf55f04294a3d97800142bdca9"}]}] Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerStableDeviceRescueTest-1642713032 Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Tenant-Id: 82eb4fbf55f04294a3d97800142bdca9 Apr 14 03:18:09 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1642713032 Apr 14 03:18:09 user devstack@n-api.service[61664]: X-User: tempest-ServerStableDeviceRescueTest-1642713032-project-member Apr 14 03:18:09 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:18:09 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:18:09 user devstack@n-api.service[61664]: X-User-Id: 3c683fe5636b49858857033797ff8e68 Apr 14 03:18:09 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerStableDeviceRescueTest-1642713032-project-member Apr 14 03:18:09 user devstack@n-api.service[61664]: method: > Apr 14 03:18:09 user devstack@n-api.service[61664]: exception: Instance 8a67985b-1938-4b7d-b486-13f6811611f3 could not be found. Apr 14 03:18:09 user devstack@n-api.service[61664]: action_args: {'id': '8a67985b-1938-4b7d-b486-13f6811611f3'} Apr 14 03:18:09 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a67985b-1938-4b7d-b486-13f6811611f3 could not be found. Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a67985b-1938-4b7d-b486-13f6811611f3 could not be found. Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a67985b-1938-4b7d-b486-13f6811611f3 could not be found. Apr 14 03:18:09 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:18:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Returning 404 to user: Instance 8a67985b-1938-4b7d-b486-13f6811611f3 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:18:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2c3e5381-d2bb-48f0-986d-5c24d5ab3110 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3" status: 404 len: 111 microversion: 2.1 time: 0.031540 Apr 14 03:18:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 278/830] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:18:09 2023] GET /compute/v2.1/servers/8a67985b-1938-4b7d-b486-13f6811611f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:18:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a697205c-5ea7-4e10-8a63-983896e453f9 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] Calling method '.version_select at 0x7ff11a4e2d40>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:18:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a697205c-5ea7-4e10-8a63-983896e453f9 tempest-ServerStableDeviceRescueTest-1642713032 tempest-ServerStableDeviceRescueTest-1642713032-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447416444" status: 202 len: 0 microversion: 2.1 time: 0.028242 Apr 14 03:18:09 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 278/831] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 03:18:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447416444 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-809fedca-0e6c-44c6-a6a7-59a587a82108 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "85fe392a-ee18-4801-b7f3-d1fefff51c4f"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-809fedca-0e6c-44c6-a6a7-59a587a82108 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=10 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-809fedca-0e6c-44c6-a6a7-59a587a82108 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-809fedca-0e6c-44c6-a6a7-59a587a82108 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-809fedca-0e6c-44c6-a6a7-59a587a82108 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-809fedca-0e6c-44c6-a6a7-59a587a82108 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-809fedca-0e6c-44c6-a6a7-59a587a82108 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-809fedca-0e6c-44c6-a6a7-59a587a82108 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:20 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-809fedca-0e6c-44c6-a6a7-59a587a82108 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lazy-loading 'flavor' on Instance uuid ca85d0c8-d192-4bdf-b607-6fe637ad6f81 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:18:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-809fedca-0e6c-44c6-a6a7-59a587a82108 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81/action" status: 200 len: 29 microversion: 2.87 time: 0.715275 Apr 14 03:18:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 276/832] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 03:18:20 2023] POST /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81/action => generated 29 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=16 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:18:21 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:18:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-52300e98-1781-4f64-b1bc-5dc32e31abdf tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81" status: 200 len: 1775 microversion: 2.87 time: 0.345565 Apr 14 03:18:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 279/833] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:18:21 2023] GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81 => generated 1775 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:18:22 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:22 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:22 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e756922d-460f-4c23-95c8-75851731f2af tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: .version_select at 0x7ff11a1f96c0>, body: {"keypair": {"name": "tempest-keypair-1704381483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/ufTFDXnGMjwB2FSg+A9mMX0vCesLJiAzD3NMUcRVyCg0qAk7buF7y/zaESmh9YTRgnJRFZQSsoliYulIJhfUVJEsLn5+ezAqOMz+G6LfzgivXohWdPYf/eGFCH+h13A=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:22 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-e756922d-460f-4c23-95c8-75851731f2af tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for project 3b689b65111045168cf21c51bf1274f2. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:18:22 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-e756922d-460f-4c23-95c8-75851731f2af tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for user c1390cde350341c3ac0275e429146cf8 and project 3b689b65111045168cf21c51bf1274f2. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:18:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e756922d-460f-4c23-95c8-75851731f2af tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126195 Apr 14 03:18:22 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 279/834] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:18:22 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:18:22 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-e472632d-dff0-4290-9d6b-6ad22b9b4617 req-b04eadbe-6d7b-451c-a916-4675aab899f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-unplugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e472632d-dff0-4290-9d6b-6ad22b9b4617 req-b04eadbe-6d7b-451c-a916-4675aab899f6 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e472632d-dff0-4290-9d6b-6ad22b9b4617 req-b04eadbe-6d7b-451c-a916-4675aab899f6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e472632d-dff0-4290-9d6b-6ad22b9b4617 req-b04eadbe-6d7b-451c-a916-4675aab899f6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:22 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-e472632d-dff0-4290-9d6b-6ad22b9b4617 req-b04eadbe-6d7b-451c-a916-4675aab899f6 service nova] Creating event network-vif-unplugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:18:22 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-e472632d-dff0-4290-9d6b-6ad22b9b4617 req-b04eadbe-6d7b-451c-a916-4675aab899f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037291 Apr 14 03:18:22 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 277/835] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:18:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:18:23 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-260481439", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c6419e57-87af-44c1-a594-3a6a40f976b8"}], "security_groups": [{"name": "tempest-securitygroup--718460721"}], "key_name": "tempest-keypair-1704381483", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] validate_networks() for [('c6419e57-87af-44c1-a594-3a6a40f976b8', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:18:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-45c79053-f8bf-4362-9945-87ce86e51646 req-453c1a73-9d66-4b42-b579-a57916c45e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-plugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-45c79053-f8bf-4362-9945-87ce86e51646 req-453c1a73-9d66-4b42-b579-a57916c45e79 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-45c79053-f8bf-4362-9945-87ce86e51646 req-453c1a73-9d66-4b42-b579-a57916c45e79 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-45c79053-f8bf-4362-9945-87ce86e51646 req-453c1a73-9d66-4b42-b579-a57916c45e79 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-45c79053-f8bf-4362-9945-87ce86e51646 req-453c1a73-9d66-4b42-b579-a57916c45e79 service nova] Creating event network-vif-plugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:18:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-45c79053-f8bf-4362-9945-87ce86e51646 req-453c1a73-9d66-4b42-b579-a57916c45e79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089485 Apr 14 03:18:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 280/836] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:18:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for project 3b689b65111045168cf21c51bf1274f2. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for user c1390cde350341c3ac0275e429146cf8 and project 3b689b65111045168cf21c51bf1274f2. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:18:24 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:18:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-aceced2e-7dfc-4ff6-9fc3-0d43cc25deb5 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.989947 Apr 14 03:18:24 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 280/837] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:18:23 2023] POST /compute/v2.1/servers => generated 399 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:18:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-ca454d01-5255-40a1-afdf-fcebd3a57d1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:18:24 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-ca454d01-5255-40a1-afdf-fcebd3a57d1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:24 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-ca454d01-5255-40a1-afdf-fcebd3a57d1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:18:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-ca454d01-5255-40a1-afdf-fcebd3a57d1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7" status: 200 len: 1235 microversion: 2.1 time: 0.068447 Apr 14 03:18:24 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 278/838] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:18:24 2023] GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:18:26 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-e56428b7-196e-4f54-9b31-fd790bce1cbd req-e4170257-6e98-4e6b-80ac-2176b18d4e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-plugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e56428b7-196e-4f54-9b31-fd790bce1cbd req-e4170257-6e98-4e6b-80ac-2176b18d4e01 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e56428b7-196e-4f54-9b31-fd790bce1cbd req-e4170257-6e98-4e6b-80ac-2176b18d4e01 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e56428b7-196e-4f54-9b31-fd790bce1cbd req-e4170257-6e98-4e6b-80ac-2176b18d4e01 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e56428b7-196e-4f54-9b31-fd790bce1cbd req-e4170257-6e98-4e6b-80ac-2176b18d4e01 service nova] Creating event network-vif-plugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:18:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-e56428b7-196e-4f54-9b31-fd790bce1cbd req-e4170257-6e98-4e6b-80ac-2176b18d4e01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036462 Apr 14 03:18:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 281/839] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:18:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:18:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-0ffa701f-652d-494d-a83b-49252913f408 req-80ac9b16-1aab-4e4a-b034-0fe1af054e7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04737acf-2aa7-4f8c-a33d-fa2b50ea29d7", "tag": "4ceedbf8-a65d-4a77-b13c-837ae6290ea1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0ffa701f-652d-494d-a83b-49252913f408 req-80ac9b16-1aab-4e4a-b034-0fe1af054e7f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0ffa701f-652d-494d-a83b-49252913f408 req-80ac9b16-1aab-4e4a-b034-0fe1af054e7f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0ffa701f-652d-494d-a83b-49252913f408 req-80ac9b16-1aab-4e4a-b034-0fe1af054e7f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0ffa701f-652d-494d-a83b-49252913f408 req-80ac9b16-1aab-4e4a-b034-0fe1af054e7f service nova] Creating event network-changed:4ceedbf8-a65d-4a77-b13c-837ae6290ea1 for instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 on user Apr 14 03:18:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-0ffa701f-652d-494d-a83b-49252913f408 req-80ac9b16-1aab-4e4a-b034-0fe1af054e7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053887 Apr 14 03:18:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 281/840] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:18:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:18:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-cc3d62f0-5c55-44c7-87b0-6b4277835476 req-de7d9c1e-063b-441e-a5a7-360501885219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-plugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-cc3d62f0-5c55-44c7-87b0-6b4277835476 req-de7d9c1e-063b-441e-a5a7-360501885219 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-cc3d62f0-5c55-44c7-87b0-6b4277835476 req-de7d9c1e-063b-441e-a5a7-360501885219 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-cc3d62f0-5c55-44c7-87b0-6b4277835476 req-de7d9c1e-063b-441e-a5a7-360501885219 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-cc3d62f0-5c55-44c7-87b0-6b4277835476 req-de7d9c1e-063b-441e-a5a7-360501885219 service nova] Creating event network-vif-plugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:18:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-cc3d62f0-5c55-44c7-87b0-6b4277835476 req-de7d9c1e-063b-441e-a5a7-360501885219 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.334551 Apr 14 03:18:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 279/841] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:18:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:18:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3f82a5cb-0867-45ab-8311-9527fe2fa85c req-297f1f29-dda5-4c03-8eda-dadee4980080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04737acf-2aa7-4f8c-a33d-fa2b50ea29d7", "name": "network-vif-plugged", "status": "completed", "tag": "4ceedbf8-a65d-4a77-b13c-837ae6290ea1"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3f82a5cb-0867-45ab-8311-9527fe2fa85c req-297f1f29-dda5-4c03-8eda-dadee4980080 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3f82a5cb-0867-45ab-8311-9527fe2fa85c req-297f1f29-dda5-4c03-8eda-dadee4980080 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3f82a5cb-0867-45ab-8311-9527fe2fa85c req-297f1f29-dda5-4c03-8eda-dadee4980080 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3f82a5cb-0867-45ab-8311-9527fe2fa85c req-297f1f29-dda5-4c03-8eda-dadee4980080 service nova] Creating event network-vif-plugged:4ceedbf8-a65d-4a77-b13c-837ae6290ea1 for instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 on user Apr 14 03:18:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3f82a5cb-0867-45ab-8311-9527fe2fa85c req-297f1f29-dda5-4c03-8eda-dadee4980080 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049317 Apr 14 03:18:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 282/842] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:18:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:18:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-76a3843a-f41d-4422-8fb4-26c8233b5b52 req-65decf19-127a-4c7b-bfbe-4907e97b06e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04737acf-2aa7-4f8c-a33d-fa2b50ea29d7", "name": "network-vif-plugged", "status": "completed", "tag": "4ceedbf8-a65d-4a77-b13c-837ae6290ea1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:18:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-76a3843a-f41d-4422-8fb4-26c8233b5b52 req-65decf19-127a-4c7b-bfbe-4907e97b06e9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-76a3843a-f41d-4422-8fb4-26c8233b5b52 req-65decf19-127a-4c7b-bfbe-4907e97b06e9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-76a3843a-f41d-4422-8fb4-26c8233b5b52 req-65decf19-127a-4c7b-bfbe-4907e97b06e9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-76a3843a-f41d-4422-8fb4-26c8233b5b52 req-65decf19-127a-4c7b-bfbe-4907e97b06e9 service nova] Creating event network-vif-plugged:4ceedbf8-a65d-4a77-b13c-837ae6290ea1 for instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 on user Apr 14 03:18:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-76a3843a-f41d-4422-8fb4-26c8233b5b52 req-65decf19-127a-4c7b-bfbe-4907e97b06e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038543 Apr 14 03:18:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 282/843] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:18:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:18:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-6bddfeaa-d23d-4578-8575-0be70bf995c2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:18:37 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-6bddfeaa-d23d-4578-8575-0be70bf995c2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:37 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6bddfeaa-d23d-4578-8575-0be70bf995c2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6bddfeaa-d23d-4578-8575-0be70bf995c2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6bddfeaa-d23d-4578-8575-0be70bf995c2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6bddfeaa-d23d-4578-8575-0be70bf995c2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6bddfeaa-d23d-4578-8575-0be70bf995c2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6bddfeaa-d23d-4578-8575-0be70bf995c2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:37 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-6bddfeaa-d23d-4578-8575-0be70bf995c2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:18:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-6bddfeaa-d23d-4578-8575-0be70bf995c2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 200 len: 1534 microversion: 2.1 time: 0.185242 Apr 14 03:18:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 280/844] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:18:37 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 1534 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-48925443-aded-4dde-a0a7-01aebec8c3f6 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-48925443-aded-4dde-a0a7-01aebec8c3f6 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-48925443-aded-4dde-a0a7-01aebec8c3f6 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-48925443-aded-4dde-a0a7-01aebec8c3f6 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-48925443-aded-4dde-a0a7-01aebec8c3f6 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-48925443-aded-4dde-a0a7-01aebec8c3f6 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-48925443-aded-4dde-a0a7-01aebec8c3f6 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-48925443-aded-4dde-a0a7-01aebec8c3f6 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:52 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-48925443-aded-4dde-a0a7-01aebec8c3f6 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:18:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-48925443-aded-4dde-a0a7-01aebec8c3f6 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 200 len: 1545 microversion: 2.1 time: 0.154163 Apr 14 03:18:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 283/845] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:18:52 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 1545 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=12 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c66d44f7-1005-4dfd-a296-fe96d7b22b51 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c66d44f7-1005-4dfd-a296-fe96d7b22b51 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c66d44f7-1005-4dfd-a296-fe96d7b22b51 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c66d44f7-1005-4dfd-a296-fe96d7b22b51 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c66d44f7-1005-4dfd-a296-fe96d7b22b51 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c66d44f7-1005-4dfd-a296-fe96d7b22b51 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c66d44f7-1005-4dfd-a296-fe96d7b22b51 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:18:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c66d44f7-1005-4dfd-a296-fe96d7b22b51 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:18:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c66d44f7-1005-4dfd-a296-fe96d7b22b51 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.156589 Apr 14 03:18:57 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 283/846] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:18:57 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 25 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:19:00 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64d3b548-9384-41f0-b6cb-e80306d79286"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:19:00 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:00 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=12 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:00 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:00 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277261 Apr 14 03:19:00 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 281/847] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:19:00 2023] POST /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:08 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lazy-loading 'services' on Instance uuid 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:19:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments/64d3b548-9384-41f0-b6cb-e80306d79286" status: 202 len: 0 microversion: 2.1 time: 0.176519 Apr 14 03:19:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 284/848] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:19:08 2023] DELETE /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments/64d3b548-9384-41f0-b6cb-e80306d79286 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:19:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f5f36211-c049-4668-834a-68a59ce3763c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:08 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f5f36211-c049-4668-834a-68a59ce3763c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:08 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:08 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f5f36211-c049-4668-834a-68a59ce3763c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f5f36211-c049-4668-834a-68a59ce3763c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f5f36211-c049-4668-834a-68a59ce3763c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f5f36211-c049-4668-834a-68a59ce3763c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f5f36211-c049-4668-834a-68a59ce3763c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f5f36211-c049-4668-834a-68a59ce3763c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f5f36211-c049-4668-834a-68a59ce3763c tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048560 Apr 14 03:19:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 284/849] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:19:08 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:11 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:11 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-fa8dbb2b-2f5f-49a3-bc9a-150087e5f7df tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81" status: 200 len: 1755 microversion: 2.87 time: 0.182365 Apr 14 03:19:11 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 282/850] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:19:11 2023] GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:19:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ac2e9dd1-986f-40ef-b627-91efa30dc226 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:15 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ac2e9dd1-986f-40ef-b627-91efa30dc226 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ac2e9dd1-986f-40ef-b627-91efa30dc226 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ac2e9dd1-986f-40ef-b627-91efa30dc226 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ac2e9dd1-986f-40ef-b627-91efa30dc226 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ac2e9dd1-986f-40ef-b627-91efa30dc226 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ac2e9dd1-986f-40ef-b627-91efa30dc226 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ac2e9dd1-986f-40ef-b627-91efa30dc226 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:15 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-ac2e9dd1-986f-40ef-b627-91efa30dc226 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ac2e9dd1-986f-40ef-b627-91efa30dc226 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7" status: 200 len: 1544 microversion: 2.1 time: 0.149136 Apr 14 03:19:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 285/851] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:19:15 2023] GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 => generated 1544 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7c454a72-bf3d-4b0b-a4e5-dd8a40b59a6c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7c454a72-bf3d-4b0b-a4e5-dd8a40b59a6c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c454a72-bf3d-4b0b-a4e5-dd8a40b59a6c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c454a72-bf3d-4b0b-a4e5-dd8a40b59a6c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c454a72-bf3d-4b0b-a4e5-dd8a40b59a6c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c454a72-bf3d-4b0b-a4e5-dd8a40b59a6c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c454a72-bf3d-4b0b-a4e5-dd8a40b59a6c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c454a72-bf3d-4b0b-a4e5-dd8a40b59a6c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:37 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7c454a72-bf3d-4b0b-a4e5-dd8a40b59a6c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7c454a72-bf3d-4b0b-a4e5-dd8a40b59a6c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 200 len: 1534 microversion: 2.1 time: 0.204472 Apr 14 03:19:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 285/852] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:19:37 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 1534 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:19:37 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:37 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:37 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:37 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Searching by: {'deleted': False, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb'} {{(pid=61662) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 03:19:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:38 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:38 user devstack@n-api.service[61662]: DEBUG nova.compute.multi_cell_list [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61662) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 03:19:38 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b58a0d40-8199-4fae-9132-7cfd8be5f6fd tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.166087 Apr 14 03:19:38 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 283/853] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 03:19:37 2023] GET /compute/v2.1/servers => generated 340 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-16f62af5-f50c-4f89-b471-b3f438ddd12f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-16f62af5-f50c-4f89-b471-b3f438ddd12f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f62af5-f50c-4f89-b471-b3f438ddd12f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f62af5-f50c-4f89-b471-b3f438ddd12f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f62af5-f50c-4f89-b471-b3f438ddd12f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f62af5-f50c-4f89-b471-b3f438ddd12f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f62af5-f50c-4f89-b471-b3f438ddd12f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f62af5-f50c-4f89-b471-b3f438ddd12f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:38 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-16f62af5-f50c-4f89-b471-b3f438ddd12f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-16f62af5-f50c-4f89-b471-b3f438ddd12f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 200 len: 1534 microversion: 2.1 time: 0.146823 Apr 14 03:19:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 286/854] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:19:38 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 1534 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:19:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96f437f9-4897-417a-95e3-097d2ff29476"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:19:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306879 Apr 14 03:19:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 286/855] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:19:39 2023] POST /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-16a63590-09a6-479e-9435-3b3d3ad7a90f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-16a63590-09a6-479e-9435-3b3d3ad7a90f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=8 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-16a63590-09a6-479e-9435-3b3d3ad7a90f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-16a63590-09a6-479e-9435-3b3d3ad7a90f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-16a63590-09a6-479e-9435-3b3d3ad7a90f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-16a63590-09a6-479e-9435-3b3d3ad7a90f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-16a63590-09a6-479e-9435-3b3d3ad7a90f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-16a63590-09a6-479e-9435-3b3d3ad7a90f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:51 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-16a63590-09a6-479e-9435-3b3d3ad7a90f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:51 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-16a63590-09a6-479e-9435-3b3d3ad7a90f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 200 len: 1580 microversion: 2.1 time: 0.157889 Apr 14 03:19:51 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 284/856] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:19:51 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 1580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:19:52 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:52 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-739ce1a3-c08f-442d-80d5-e7efbec814fc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:52 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-739ce1a3-c08f-442d-80d5-e7efbec814fc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-739ce1a3-c08f-442d-80d5-e7efbec814fc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-739ce1a3-c08f-442d-80d5-e7efbec814fc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-739ce1a3-c08f-442d-80d5-e7efbec814fc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-739ce1a3-c08f-442d-80d5-e7efbec814fc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-739ce1a3-c08f-442d-80d5-e7efbec814fc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-739ce1a3-c08f-442d-80d5-e7efbec814fc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:52 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:52 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d73f0ddf-43c5-443c-b846-01e6938f278f req-749fe423-cdd3-43b9-9bec-04deb41bf756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:19:53 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-739ce1a3-c08f-442d-80d5-e7efbec814fc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d73f0ddf-43c5-443c-b846-01e6938f278f req-749fe423-cdd3-43b9-9bec-04deb41bf756 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d73f0ddf-43c5-443c-b846-01e6938f278f req-749fe423-cdd3-43b9-9bec-04deb41bf756 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d73f0ddf-43c5-443c-b846-01e6938f278f req-749fe423-cdd3-43b9-9bec-04deb41bf756 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-739ce1a3-c08f-442d-80d5-e7efbec814fc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 200 len: 1545 microversion: 2.1 time: 0.380608 Apr 14 03:19:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 287/857] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:19:52 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 1545 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:19:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d73f0ddf-43c5-443c-b846-01e6938f278f req-749fe423-cdd3-43b9-9bec-04deb41bf756 service nova] Creating event network-changed:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:19:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d73f0ddf-43c5-443c-b846-01e6938f278f req-749fe423-cdd3-43b9-9bec-04deb41bf756 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103634 Apr 14 03:19:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 287/858] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:19:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:19:53 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-0753309c-6dc0-4e2b-b177-e0e339ef2f63 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:19:53 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-0753309c-6dc0-4e2b-b177-e0e339ef2f63 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0753309c-6dc0-4e2b-b177-e0e339ef2f63 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0753309c-6dc0-4e2b-b177-e0e339ef2f63 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0753309c-6dc0-4e2b-b177-e0e339ef2f63 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0753309c-6dc0-4e2b-b177-e0e339ef2f63 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0753309c-6dc0-4e2b-b177-e0e339ef2f63 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0753309c-6dc0-4e2b-b177-e0e339ef2f63 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:53 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-0753309c-6dc0-4e2b-b177-e0e339ef2f63 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210/action" status: 200 len: 28492 microversion: 2.1 time: 0.219705 Apr 14 03:19:53 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 285/859] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:19:53 2023] POST /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210/action => generated 28492 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:19:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-750ae5a9-15e1-45dc-b90a-2bd132a1b1ab tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:53 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-750ae5a9-15e1-45dc-b90a-2bd132a1b1ab tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 24d1359d-2dcd-46d7-90f3-3801df9be357] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-750ae5a9-15e1-45dc-b90a-2bd132a1b1ab tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-750ae5a9-15e1-45dc-b90a-2bd132a1b1ab tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-750ae5a9-15e1-45dc-b90a-2bd132a1b1ab tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-750ae5a9-15e1-45dc-b90a-2bd132a1b1ab tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-750ae5a9-15e1-45dc-b90a-2bd132a1b1ab tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-750ae5a9-15e1-45dc-b90a-2bd132a1b1ab tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:53 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-750ae5a9-15e1-45dc-b90a-2bd132a1b1ab tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-750ae5a9-15e1-45dc-b90a-2bd132a1b1ab tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357" status: 200 len: 1537 microversion: 2.1 time: 0.163839 Apr 14 03:19:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 288/860] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:19:53 2023] GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357 => generated 1537 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:19:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9e3bc493-6c02-41e4-92ad-591d0f26523e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1195535830"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:19:54 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9e3bc493-6c02-41e4-92ad-591d0f26523e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9e3bc493-6c02-41e4-92ad-591d0f26523e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9e3bc493-6c02-41e4-92ad-591d0f26523e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9e3bc493-6c02-41e4-92ad-591d0f26523e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9e3bc493-6c02-41e4-92ad-591d0f26523e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9e3bc493-6c02-41e4-92ad-591d0f26523e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9e3bc493-6c02-41e4-92ad-591d0f26523e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:54 user devstack@n-api.service[61664]: INFO nova.network.security_group_api [None req-9e3bc493-6c02-41e4-92ad-591d0f26523e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Adding security group 3c49bd70-79fa-413a-9fda-b0c8edbb1087 to port a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 Apr 14 03:19:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9e3bc493-6c02-41e4-92ad-591d0f26523e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/action" status: 202 len: 0 microversion: 2.1 time: 0.690644 Apr 14 03:19:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 288/861] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:19:54 2023] POST /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/action => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:19:54 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-736590d0-f940-4456-8c7d-f1bc73028a2d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:54 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-736590d0-f940-4456-8c7d-f1bc73028a2d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-736590d0-f940-4456-8c7d-f1bc73028a2d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-736590d0-f940-4456-8c7d-f1bc73028a2d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-736590d0-f940-4456-8c7d-f1bc73028a2d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-736590d0-f940-4456-8c7d-f1bc73028a2d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-736590d0-f940-4456-8c7d-f1bc73028a2d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-736590d0-f940-4456-8c7d-f1bc73028a2d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-f1d391c1-08cd-4f86-8960-944ebf31962c req-1ccc9893-6139-49bf-b802-86cfec0f95e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:19:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f1d391c1-08cd-4f86-8960-944ebf31962c req-1ccc9893-6139-49bf-b802-86cfec0f95e1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f1d391c1-08cd-4f86-8960-944ebf31962c req-1ccc9893-6139-49bf-b802-86cfec0f95e1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f1d391c1-08cd-4f86-8960-944ebf31962c req-1ccc9893-6139-49bf-b802-86cfec0f95e1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f1d391c1-08cd-4f86-8960-944ebf31962c req-1ccc9893-6139-49bf-b802-86cfec0f95e1 service nova] Creating event network-changed:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:19:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-f1d391c1-08cd-4f86-8960-944ebf31962c req-1ccc9893-6139-49bf-b802-86cfec0f95e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034022 Apr 14 03:19:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 289/862] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:19:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:19:55 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-736590d0-f940-4456-8c7d-f1bc73028a2d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:55 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-736590d0-f940-4456-8c7d-f1bc73028a2d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 200 len: 1745 microversion: 2.1 time: 0.165549 Apr 14 03:19:55 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 286/863] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:19:54 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:19:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d7098546-af94-480c-962b-9ff9fe262004 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:58 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d7098546-af94-480c-962b-9ff9fe262004 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7098546-af94-480c-962b-9ff9fe262004 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7098546-af94-480c-962b-9ff9fe262004 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7098546-af94-480c-962b-9ff9fe262004 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7098546-af94-480c-962b-9ff9fe262004 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7098546-af94-480c-962b-9ff9fe262004 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d7098546-af94-480c-962b-9ff9fe262004 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d7098546-af94-480c-962b-9ff9fe262004 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075037 Apr 14 03:19:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 289/864] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:19:58 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:19:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-686a2134-fa40-4b25-a9cb-8492a4424ac8 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:19:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-686a2134-fa40-4b25-a9cb-8492a4424ac8 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-686a2134-fa40-4b25-a9cb-8492a4424ac8 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-686a2134-fa40-4b25-a9cb-8492a4424ac8 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-686a2134-fa40-4b25-a9cb-8492a4424ac8 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-686a2134-fa40-4b25-a9cb-8492a4424ac8 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-686a2134-fa40-4b25-a9cb-8492a4424ac8 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-686a2134-fa40-4b25-a9cb-8492a4424ac8 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-686a2134-fa40-4b25-a9cb-8492a4424ac8 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/action" status: 202 len: 0 microversion: 2.1 time: 0.101072 Apr 14 03:19:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 290/865] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:19:58 2023] POST /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:19:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-803fe324-33af-4072-9b93-42630bed2761 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:19:58 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-803fe324-33af-4072-9b93-42630bed2761 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:19:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-803fe324-33af-4072-9b93-42630bed2761 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-803fe324-33af-4072-9b93-42630bed2761 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-803fe324-33af-4072-9b93-42630bed2761 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-803fe324-33af-4072-9b93-42630bed2761 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-803fe324-33af-4072-9b93-42630bed2761 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-803fe324-33af-4072-9b93-42630bed2761 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:58 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-803fe324-33af-4072-9b93-42630bed2761 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:19:58 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-803fe324-33af-4072-9b93-42630bed2761 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 200 len: 1747 microversion: 2.1 time: 0.160846 Apr 14 03:19:58 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 287/866] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:19:58 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:19:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-42822657-10e4-4c51-adee-2f6b2424d118 req-2ad74ccf-10ec-4876-a17e-da2ea40ec835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "name": "network-vif-unplugged", "status": "completed", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:19:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-42822657-10e4-4c51-adee-2f6b2424d118 req-2ad74ccf-10ec-4876-a17e-da2ea40ec835 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:19:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-42822657-10e4-4c51-adee-2f6b2424d118 req-2ad74ccf-10ec-4876-a17e-da2ea40ec835 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:19:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-42822657-10e4-4c51-adee-2f6b2424d118 req-2ad74ccf-10ec-4876-a17e-da2ea40ec835 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:19:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-42822657-10e4-4c51-adee-2f6b2424d118 req-2ad74ccf-10ec-4876-a17e-da2ea40ec835 service nova] Creating event network-vif-unplugged:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:19:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-42822657-10e4-4c51-adee-2f6b2424d118 req-2ad74ccf-10ec-4876-a17e-da2ea40ec835 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104676 Apr 14 03:19:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 290/867] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:19:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-8faf76ca-5d72-40c4-ad30-84205a9f31a9 req-0b88d6a5-ee53-4ca5-ae28-dd54fe6a981e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "name": "network-vif-plugged", "status": "completed", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8faf76ca-5d72-40c4-ad30-84205a9f31a9 req-0b88d6a5-ee53-4ca5-ae28-dd54fe6a981e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8faf76ca-5d72-40c4-ad30-84205a9f31a9 req-0b88d6a5-ee53-4ca5-ae28-dd54fe6a981e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8faf76ca-5d72-40c4-ad30-84205a9f31a9 req-0b88d6a5-ee53-4ca5-ae28-dd54fe6a981e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-8faf76ca-5d72-40c4-ad30-84205a9f31a9 req-0b88d6a5-ee53-4ca5-ae28-dd54fe6a981e service nova] Creating event network-vif-plugged:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:20:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-8faf76ca-5d72-40c4-ad30-84205a9f31a9 req-0b88d6a5-ee53-4ca5-ae28-dd54fe6a981e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031315 Apr 14 03:20:01 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 291/868] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:04 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-f823d95c-99bd-4bc7-9bec-962485566d56 req-b52edbaa-aee4-4fa4-bc94-38764df258dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "name": "network-vif-plugged", "status": "completed", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f823d95c-99bd-4bc7-9bec-962485566d56 req-b52edbaa-aee4-4fa4-bc94-38764df258dc service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f823d95c-99bd-4bc7-9bec-962485566d56 req-b52edbaa-aee4-4fa4-bc94-38764df258dc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-f823d95c-99bd-4bc7-9bec-962485566d56 req-b52edbaa-aee4-4fa4-bc94-38764df258dc service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-f823d95c-99bd-4bc7-9bec-962485566d56 req-b52edbaa-aee4-4fa4-bc94-38764df258dc service nova] Creating event network-vif-plugged:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:20:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-f823d95c-99bd-4bc7-9bec-962485566d56 req-b52edbaa-aee4-4fa4-bc94-38764df258dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053859 Apr 14 03:20:04 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 288/869] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-df0e6fc9-642c-4e8f-b848-f9121bf71d9e req-40785a21-27ef-44e6-bd52-ee55227e6dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "name": "network-vif-plugged", "status": "completed", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-df0e6fc9-642c-4e8f-b848-f9121bf71d9e req-40785a21-27ef-44e6-bd52-ee55227e6dfd service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-df0e6fc9-642c-4e8f-b848-f9121bf71d9e req-40785a21-27ef-44e6-bd52-ee55227e6dfd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-df0e6fc9-642c-4e8f-b848-f9121bf71d9e req-40785a21-27ef-44e6-bd52-ee55227e6dfd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-df0e6fc9-642c-4e8f-b848-f9121bf71d9e req-40785a21-27ef-44e6-bd52-ee55227e6dfd service nova] Creating event network-vif-plugged:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:20:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-df0e6fc9-642c-4e8f-b848-f9121bf71d9e req-40785a21-27ef-44e6-bd52-ee55227e6dfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036046 Apr 14 03:20:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 291/870] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:11 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:11 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:11 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f24c2e95-ed90-476b-bbd7-f5b728ed8314 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:11 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f24c2e95-ed90-476b-bbd7-f5b728ed8314 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f24c2e95-ed90-476b-bbd7-f5b728ed8314 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f24c2e95-ed90-476b-bbd7-f5b728ed8314 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f24c2e95-ed90-476b-bbd7-f5b728ed8314 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f24c2e95-ed90-476b-bbd7-f5b728ed8314 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f24c2e95-ed90-476b-bbd7-f5b728ed8314 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f24c2e95-ed90-476b-bbd7-f5b728ed8314 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:11 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f24c2e95-ed90-476b-bbd7-f5b728ed8314 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81/action" status: 202 len: 0 microversion: 2.87 time: 0.100856 Apr 14 03:20:11 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 292/871] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 03:20:11 2023] POST /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 14 03:20:11 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:20:11 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:12 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:20:12 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:20:12 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:20:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f6e096cc-884b-414d-8555-44a250a15195 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81" status: 200 len: 1763 microversion: 2.87 time: 0.233433 Apr 14 03:20:12 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 289/872] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:20:11 2023] GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81 => generated 1763 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:20:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9e0ed0c8-e735-441e-86e7-dbc1a0310c24 req-6a690e0f-3df6-42c5-b84c-1e47621c6993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-unplugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9e0ed0c8-e735-441e-86e7-dbc1a0310c24 req-6a690e0f-3df6-42c5-b84c-1e47621c6993 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9e0ed0c8-e735-441e-86e7-dbc1a0310c24 req-6a690e0f-3df6-42c5-b84c-1e47621c6993 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9e0ed0c8-e735-441e-86e7-dbc1a0310c24 req-6a690e0f-3df6-42c5-b84c-1e47621c6993 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9e0ed0c8-e735-441e-86e7-dbc1a0310c24 req-6a690e0f-3df6-42c5-b84c-1e47621c6993 service nova] Creating event network-vif-unplugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:20:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9e0ed0c8-e735-441e-86e7-dbc1a0310c24 req-6a690e0f-3df6-42c5-b84c-1e47621c6993 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127571 Apr 14 03:20:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 292/873] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c6404d0e-c6a5-4039-9d69-419ef13637ed req-9c54c5a6-c61c-4ac7-be45-32cb0501a9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-plugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c6404d0e-c6a5-4039-9d69-419ef13637ed req-9c54c5a6-c61c-4ac7-be45-32cb0501a9b1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c6404d0e-c6a5-4039-9d69-419ef13637ed req-9c54c5a6-c61c-4ac7-be45-32cb0501a9b1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c6404d0e-c6a5-4039-9d69-419ef13637ed req-9c54c5a6-c61c-4ac7-be45-32cb0501a9b1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c6404d0e-c6a5-4039-9d69-419ef13637ed req-9c54c5a6-c61c-4ac7-be45-32cb0501a9b1 service nova] Creating event network-vif-plugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:20:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c6404d0e-c6a5-4039-9d69-419ef13637ed req-9c54c5a6-c61c-4ac7-be45-32cb0501a9b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035634 Apr 14 03:20:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 293/874] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:15 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-832f7c59-c910-43eb-a4cc-bfc296fbe3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:20:15 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-832f7c59-c910-43eb-a4cc-bfc296fbe3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-832f7c59-c910-43eb-a4cc-bfc296fbe3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-832f7c59-c910-43eb-a4cc-bfc296fbe3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-832f7c59-c910-43eb-a4cc-bfc296fbe3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-832f7c59-c910-43eb-a4cc-bfc296fbe3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-832f7c59-c910-43eb-a4cc-bfc296fbe3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-832f7c59-c910-43eb-a4cc-bfc296fbe3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-832f7c59-c910-43eb-a4cc-bfc296fbe3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.115411 Apr 14 03:20:15 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 290/875] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:20:15 2023] GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/os-interface => generated 282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:16 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-949a893e-8e74-4fa7-a195-bd77b5d6b4f1 req-332fda69-d818-49c8-9651-9f3843912036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04737acf-2aa7-4f8c-a33d-fa2b50ea29d7", "tag": "4ceedbf8-a65d-4a77-b13c-837ae6290ea1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-949a893e-8e74-4fa7-a195-bd77b5d6b4f1 req-332fda69-d818-49c8-9651-9f3843912036 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-949a893e-8e74-4fa7-a195-bd77b5d6b4f1 req-332fda69-d818-49c8-9651-9f3843912036 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-949a893e-8e74-4fa7-a195-bd77b5d6b4f1 req-332fda69-d818-49c8-9651-9f3843912036 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-949a893e-8e74-4fa7-a195-bd77b5d6b4f1 req-332fda69-d818-49c8-9651-9f3843912036 service nova] Creating event network-changed:4ceedbf8-a65d-4a77-b13c-837ae6290ea1 for instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 on user Apr 14 03:20:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-949a893e-8e74-4fa7-a195-bd77b5d6b4f1 req-332fda69-d818-49c8-9651-9f3843912036 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034916 Apr 14 03:20:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 293/876] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:17 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6c9f9653-85fc-454d-a7f8-9643d35191fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:20:17 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6c9f9653-85fc-454d-a7f8-9643d35191fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6c9f9653-85fc-454d-a7f8-9643d35191fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6c9f9653-85fc-454d-a7f8-9643d35191fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6c9f9653-85fc-454d-a7f8-9643d35191fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6c9f9653-85fc-454d-a7f8-9643d35191fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6c9f9653-85fc-454d-a7f8-9643d35191fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6c9f9653-85fc-454d-a7f8-9643d35191fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6c9f9653-85fc-454d-a7f8-9643d35191fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/ips" status: 200 len: 108 microversion: 2.1 time: 0.065626 Apr 14 03:20:17 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 294/877] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 03:20:17 2023] GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/ips => generated 108 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:17 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-8e273f15-9f63-40ff-9418-f23c4727b62b req-2b02fad9-64fc-4e59-bca5-8ea10e99e81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-plugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}, {"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-plugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8e273f15-9f63-40ff-9418-f23c4727b62b req-2b02fad9-64fc-4e59-bca5-8ea10e99e81a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8e273f15-9f63-40ff-9418-f23c4727b62b req-2b02fad9-64fc-4e59-bca5-8ea10e99e81a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8e273f15-9f63-40ff-9418-f23c4727b62b req-2b02fad9-64fc-4e59-bca5-8ea10e99e81a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:17 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8e273f15-9f63-40ff-9418-f23c4727b62b req-2b02fad9-64fc-4e59-bca5-8ea10e99e81a service nova] Creating event network-vif-plugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:20:17 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8e273f15-9f63-40ff-9418-f23c4727b62b req-2b02fad9-64fc-4e59-bca5-8ea10e99e81a service nova] Creating event network-vif-plugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:20:17 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-8e273f15-9f63-40ff-9418-f23c4727b62b req-2b02fad9-64fc-4e59-bca5-8ea10e99e81a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032204 Apr 14 03:20:17 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 291/878] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-629eb2ec-c263-474a-84b9-169207390c09 req-a8da617e-6618-4a9b-b320-90ba9732efb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4", "tag": "73d42070-416a-497f-b3d4-8467d8255c5f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-629eb2ec-c263-474a-84b9-169207390c09 req-a8da617e-6618-4a9b-b320-90ba9732efb3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-629eb2ec-c263-474a-84b9-169207390c09 req-a8da617e-6618-4a9b-b320-90ba9732efb3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-629eb2ec-c263-474a-84b9-169207390c09 req-a8da617e-6618-4a9b-b320-90ba9732efb3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-629eb2ec-c263-474a-84b9-169207390c09 req-a8da617e-6618-4a9b-b320-90ba9732efb3 service nova] Creating event network-changed:73d42070-416a-497f-b3d4-8467d8255c5f for instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 on user Apr 14 03:20:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-629eb2ec-c263-474a-84b9-169207390c09 req-a8da617e-6618-4a9b-b320-90ba9732efb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035436 Apr 14 03:20:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 294/879] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-04a612b3-d249-41fa-8f92-f4b1c2794400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-04a612b3-d249-41fa-8f92-f4b1c2794400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-04a612b3-d249-41fa-8f92-f4b1c2794400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-04a612b3-d249-41fa-8f92-f4b1c2794400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-04a612b3-d249-41fa-8f92-f4b1c2794400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-04a612b3-d249-41fa-8f92-f4b1c2794400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-04a612b3-d249-41fa-8f92-f4b1c2794400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-04a612b3-d249-41fa-8f92-f4b1c2794400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-04a612b3-d249-41fa-8f92-f4b1c2794400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296477 Apr 14 03:20:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 295/880] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:20:19 2023] POST /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-70948966-d9d2-4cf8-bdd6-85cfab6637bf tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-70948966-d9d2-4cf8-bdd6-85cfab6637bf tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=19 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70948966-d9d2-4cf8-bdd6-85cfab6637bf tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70948966-d9d2-4cf8-bdd6-85cfab6637bf tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70948966-d9d2-4cf8-bdd6-85cfab6637bf tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70948966-d9d2-4cf8-bdd6-85cfab6637bf tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70948966-d9d2-4cf8-bdd6-85cfab6637bf tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-70948966-d9d2-4cf8-bdd6-85cfab6637bf tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=37 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:22 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-70948966-d9d2-4cf8-bdd6-85cfab6637bf tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:20:22 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-70948966-d9d2-4cf8-bdd6-85cfab6637bf tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4" status: 204 len: 0 microversion: 2.1 time: 0.138187 Apr 14 03:20:22 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 292/881] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:20:22 2023] DELETE /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:20:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4643ea1f-89fd-4d3b-8d6f-18b0be2c9e44 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:20:22 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4643ea1f-89fd-4d3b-8d6f-18b0be2c9e44 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4643ea1f-89fd-4d3b-8d6f-18b0be2c9e44 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4643ea1f-89fd-4d3b-8d6f-18b0be2c9e44 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4643ea1f-89fd-4d3b-8d6f-18b0be2c9e44 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4643ea1f-89fd-4d3b-8d6f-18b0be2c9e44 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4643ea1f-89fd-4d3b-8d6f-18b0be2c9e44 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4643ea1f-89fd-4d3b-8d6f-18b0be2c9e44 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:22 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-4643ea1f-89fd-4d3b-8d6f-18b0be2c9e44 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8614e27c65428d92e4bf01969976e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0096d0892acf4d5f8a0fa290a18b451a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:20:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4643ea1f-89fd-4d3b-8d6f-18b0be2c9e44 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4" status: 200 len: 1572 microversion: 2.1 time: 0.235554 Apr 14 03:20:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 295/882] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:20:22 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 => generated 1572 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:20:22 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-aca232ed-a184-4845-9fe6-d437fcaa9f4b req-13f00284-c86b-473e-8ff8-be32378541fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4", "name": "network-vif-unplugged", "status": "completed", "tag": "73d42070-416a-497f-b3d4-8467d8255c5f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aca232ed-a184-4845-9fe6-d437fcaa9f4b req-13f00284-c86b-473e-8ff8-be32378541fd service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aca232ed-a184-4845-9fe6-d437fcaa9f4b req-13f00284-c86b-473e-8ff8-be32378541fd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aca232ed-a184-4845-9fe6-d437fcaa9f4b req-13f00284-c86b-473e-8ff8-be32378541fd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-aca232ed-a184-4845-9fe6-d437fcaa9f4b req-13f00284-c86b-473e-8ff8-be32378541fd service nova] Creating event network-vif-unplugged:73d42070-416a-497f-b3d4-8467d8255c5f for instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 on user Apr 14 03:20:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-aca232ed-a184-4845-9fe6-d437fcaa9f4b req-13f00284-c86b-473e-8ff8-be32378541fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041112 Apr 14 03:20:22 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 296/883] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:24 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-69ff2501-b6fb-4c90-83ce-5c9f227fa3d1 req-beb16a1e-de6e-4e49-a7ea-aa01cd4feba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4", "name": "network-vif-plugged", "status": "completed", "tag": "73d42070-416a-497f-b3d4-8467d8255c5f"}, {"server_uuid": "9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4", "name": "network-vif-deleted", "tag": "73d42070-416a-497f-b3d4-8467d8255c5f"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-69ff2501-b6fb-4c90-83ce-5c9f227fa3d1 req-beb16a1e-de6e-4e49-a7ea-aa01cd4feba5 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-69ff2501-b6fb-4c90-83ce-5c9f227fa3d1 req-beb16a1e-de6e-4e49-a7ea-aa01cd4feba5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:24 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-69ff2501-b6fb-4c90-83ce-5c9f227fa3d1 req-beb16a1e-de6e-4e49-a7ea-aa01cd4feba5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-69ff2501-b6fb-4c90-83ce-5c9f227fa3d1 req-beb16a1e-de6e-4e49-a7ea-aa01cd4feba5 service nova] Creating event network-vif-plugged:73d42070-416a-497f-b3d4-8467d8255c5f for instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 on user Apr 14 03:20:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-69ff2501-b6fb-4c90-83ce-5c9f227fa3d1 req-beb16a1e-de6e-4e49-a7ea-aa01cd4feba5 service nova] Creating event network-vif-deleted:73d42070-416a-497f-b3d4-8467d8255c5f for instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 on user Apr 14 03:20:24 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-69ff2501-b6fb-4c90-83ce-5c9f227fa3d1 req-beb16a1e-de6e-4e49-a7ea-aa01cd4feba5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029891 Apr 14 03:20:24 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 293/884] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-06ddc04f-7865-4027-b4e3-8ea8b14a2c55 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: .version_select at 0x7ff11a650280>, body: {"keypair": {"name": "tempest-keypair-2056266938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSdJeK0I2g3r6BVK5roXFoHNwGS9/lEYRIk7CP+MH/Kk1cBXHAGb76eRSMrsWN/Ae392cfnXS4PUZ3wHpnCdSrlNAu5O+oD1xGzhmbUo4CzIPnk94ndEYbTDEjXXGjkuQ=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:27 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=19 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:27 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-06ddc04f-7865-4027-b4e3-8ea8b14a2c55 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for project 3b689b65111045168cf21c51bf1274f2. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:20:27 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-06ddc04f-7865-4027-b4e3-8ea8b14a2c55 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for user c1390cde350341c3ac0275e429146cf8 and project 3b689b65111045168cf21c51bf1274f2. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:20:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-06ddc04f-7865-4027-b4e3-8ea8b14a2c55 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056430 Apr 14 03:20:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 296/885] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:20:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-532403844", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c6419e57-87af-44c1-a594-3a6a40f976b8"}], "security_groups": [{"name": "tempest-securitygroup--546743126"}], "key_name": "tempest-keypair-2056266938", "user_data": "}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] validate_networks() for [('c6419e57-87af-44c1-a594-3a6a40f976b8', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for project 3b689b65111045168cf21c51bf1274f2. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for user c1390cde350341c3ac0275e429146cf8 and project 3b689b65111045168cf21c51bf1274f2. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:20:29 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:20:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7ed10e4e-39ef-424e-96e1-25d312ddc1e9 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.726858 Apr 14 03:20:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 297/886] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:20:29 2023] POST /compute/v2.1/servers => generated 399 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:20:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-13781c63-c27d-417b-8673-3c6a1e3d0eb8 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:20:29 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-13781c63-c27d-417b-8673-3c6a1e3d0eb8 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:29 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-13781c63-c27d-417b-8673-3c6a1e3d0eb8 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:20:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-13781c63-c27d-417b-8673-3c6a1e3d0eb8 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd" status: 200 len: 1235 microversion: 2.1 time: 0.077497 Apr 14 03:20:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 294/887] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:20:29 2023] GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd => generated 1235 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:20:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e82d9602-5ea3-4bdc-939c-f5ad815cde57 req-cfceb10e-4f4c-4c84-8a01-a67993b49af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b91538e-2a4b-453b-bfb3-5e569da0a3cd", "tag": "66cc3bdb-6829-4939-95c9-3549b7c39c65"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e82d9602-5ea3-4bdc-939c-f5ad815cde57 req-cfceb10e-4f4c-4c84-8a01-a67993b49af1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e82d9602-5ea3-4bdc-939c-f5ad815cde57 req-cfceb10e-4f4c-4c84-8a01-a67993b49af1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e82d9602-5ea3-4bdc-939c-f5ad815cde57 req-cfceb10e-4f4c-4c84-8a01-a67993b49af1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:32 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=29 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e82d9602-5ea3-4bdc-939c-f5ad815cde57 req-cfceb10e-4f4c-4c84-8a01-a67993b49af1 service nova] Creating event network-changed:66cc3bdb-6829-4939-95c9-3549b7c39c65 for instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd on user Apr 14 03:20:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e82d9602-5ea3-4bdc-939c-f5ad815cde57 req-cfceb10e-4f4c-4c84-8a01-a67993b49af1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039680 Apr 14 03:20:32 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 297/888] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-38004762-0568-49e7-a37d-cfd0c57d7142 req-ffef1f7b-5f48-4d3d-b7bd-e6b4adb7f478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b91538e-2a4b-453b-bfb3-5e569da0a3cd", "name": "network-vif-plugged", "status": "completed", "tag": "66cc3bdb-6829-4939-95c9-3549b7c39c65"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-38004762-0568-49e7-a37d-cfd0c57d7142 req-ffef1f7b-5f48-4d3d-b7bd-e6b4adb7f478 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-38004762-0568-49e7-a37d-cfd0c57d7142 req-ffef1f7b-5f48-4d3d-b7bd-e6b4adb7f478 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-38004762-0568-49e7-a37d-cfd0c57d7142 req-ffef1f7b-5f48-4d3d-b7bd-e6b4adb7f478 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-38004762-0568-49e7-a37d-cfd0c57d7142 req-ffef1f7b-5f48-4d3d-b7bd-e6b4adb7f478 service nova] Creating event network-vif-plugged:66cc3bdb-6829-4939-95c9-3549b7c39c65 for instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd on user Apr 14 03:20:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-38004762-0568-49e7-a37d-cfd0c57d7142 req-ffef1f7b-5f48-4d3d-b7bd-e6b4adb7f478 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045152 Apr 14 03:20:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 298/889] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-c95b7e36-58be-4055-983a-5a4e1dcfef99 req-02741a9b-c921-45b1-82fe-0bc0d7529701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b91538e-2a4b-453b-bfb3-5e569da0a3cd", "name": "network-vif-plugged", "status": "completed", "tag": "66cc3bdb-6829-4939-95c9-3549b7c39c65"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:36 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c95b7e36-58be-4055-983a-5a4e1dcfef99 req-02741a9b-c921-45b1-82fe-0bc0d7529701 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c95b7e36-58be-4055-983a-5a4e1dcfef99 req-02741a9b-c921-45b1-82fe-0bc0d7529701 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c95b7e36-58be-4055-983a-5a4e1dcfef99 req-02741a9b-c921-45b1-82fe-0bc0d7529701 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:36 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-c95b7e36-58be-4055-983a-5a4e1dcfef99 req-02741a9b-c921-45b1-82fe-0bc0d7529701 service nova] Creating event network-vif-plugged:66cc3bdb-6829-4939-95c9-3549b7c39c65 for instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd on user Apr 14 03:20:36 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-c95b7e36-58be-4055-983a-5a4e1dcfef99 req-02741a9b-c921-45b1-82fe-0bc0d7529701 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035295 Apr 14 03:20:36 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 295/890] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b1543bbb-b55f-4faa-828e-7487c9a1b655 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b1543bbb-b55f-4faa-828e-7487c9a1b655 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1543bbb-b55f-4faa-828e-7487c9a1b655 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1543bbb-b55f-4faa-828e-7487c9a1b655 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1543bbb-b55f-4faa-828e-7487c9a1b655 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1543bbb-b55f-4faa-828e-7487c9a1b655 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1543bbb-b55f-4faa-828e-7487c9a1b655 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1543bbb-b55f-4faa-828e-7487c9a1b655 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:49 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b1543bbb-b55f-4faa-828e-7487c9a1b655 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:20:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b1543bbb-b55f-4faa-828e-7487c9a1b655 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 200 len: 1745 microversion: 2.1 time: 0.157433 Apr 14 03:20:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 298/891] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:20:48 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-2db03106-21d6-4b86-959b-e99df1516856 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-2db03106-21d6-4b86-959b-e99df1516856 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2db03106-21d6-4b86-959b-e99df1516856 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2db03106-21d6-4b86-959b-e99df1516856 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2db03106-21d6-4b86-959b-e99df1516856 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2db03106-21d6-4b86-959b-e99df1516856 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2db03106-21d6-4b86-959b-e99df1516856 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2db03106-21d6-4b86-959b-e99df1516856 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:53 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-2db03106-21d6-4b86-959b-e99df1516856 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:20:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-2db03106-21d6-4b86-959b-e99df1516856 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 204 len: 0 microversion: 2.1 time: 0.134636 Apr 14 03:20:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 299/892] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:20:53 2023] DELETE /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c2be3e7d-9e58-4f9f-827d-5adf114eeb39 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c2be3e7d-9e58-4f9f-827d-5adf114eeb39 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2be3e7d-9e58-4f9f-827d-5adf114eeb39 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2be3e7d-9e58-4f9f-827d-5adf114eeb39 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2be3e7d-9e58-4f9f-827d-5adf114eeb39 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2be3e7d-9e58-4f9f-827d-5adf114eeb39 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2be3e7d-9e58-4f9f-827d-5adf114eeb39 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2be3e7d-9e58-4f9f-827d-5adf114eeb39 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:53 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-c2be3e7d-9e58-4f9f-827d-5adf114eeb39 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:20:53 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c2be3e7d-9e58-4f9f-827d-5adf114eeb39 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 200 len: 1551 microversion: 2.1 time: 0.162529 Apr 14 03:20:53 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 296/893] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:20:53 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:20:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d60d3f21-27a1-45c1-ad2d-e4f3b73568e4 req-9b1dec06-277b-4d5a-b486-c881114be5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "name": "network-vif-unplugged", "status": "completed", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d60d3f21-27a1-45c1-ad2d-e4f3b73568e4 req-9b1dec06-277b-4d5a-b486-c881114be5b7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d60d3f21-27a1-45c1-ad2d-e4f3b73568e4 req-9b1dec06-277b-4d5a-b486-c881114be5b7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d60d3f21-27a1-45c1-ad2d-e4f3b73568e4 req-9b1dec06-277b-4d5a-b486-c881114be5b7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d60d3f21-27a1-45c1-ad2d-e4f3b73568e4 req-9b1dec06-277b-4d5a-b486-c881114be5b7 service nova] Creating event network-vif-unplugged:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:20:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d60d3f21-27a1-45c1-ad2d-e4f3b73568e4 req-9b1dec06-277b-4d5a-b486-c881114be5b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031881 Apr 14 03:20:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 299/894] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-0ebcaa12-0f44-4e41-b88a-367a9a93c543 req-08503f7f-b586-4f8a-a2d2-a7705895f337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "name": "network-vif-deleted", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0ebcaa12-0f44-4e41-b88a-367a9a93c543 req-08503f7f-b586-4f8a-a2d2-a7705895f337 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0ebcaa12-0f44-4e41-b88a-367a9a93c543 req-08503f7f-b586-4f8a-a2d2-a7705895f337 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0ebcaa12-0f44-4e41-b88a-367a9a93c543 req-08503f7f-b586-4f8a-a2d2-a7705895f337 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-0ebcaa12-0f44-4e41-b88a-367a9a93c543 req-08503f7f-b586-4f8a-a2d2-a7705895f337 service nova] Creating event network-vif-deleted:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:20:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-0ebcaa12-0f44-4e41-b88a-367a9a93c543 req-08503f7f-b586-4f8a-a2d2-a7705895f337 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030522 Apr 14 03:20:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 300/895] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:20:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-e257177a-b19f-4795-94a9-bf2567ab9004 req-35aa9239-ba5b-4709-b732-5fd991fe2465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bf9fb-977a-4015-8739-6fa66c1ec210", "name": "network-vif-plugged", "status": "completed", "tag": "f1dbc6da-e8f9-4962-ac4c-db69105689f9"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:20:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e257177a-b19f-4795-94a9-bf2567ab9004 req-35aa9239-ba5b-4709-b732-5fd991fe2465 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:20:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e257177a-b19f-4795-94a9-bf2567ab9004 req-35aa9239-ba5b-4709-b732-5fd991fe2465 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:20:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e257177a-b19f-4795-94a9-bf2567ab9004 req-35aa9239-ba5b-4709-b732-5fd991fe2465 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:20:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-e257177a-b19f-4795-94a9-bf2567ab9004 req-35aa9239-ba5b-4709-b732-5fd991fe2465 service nova] Creating event network-vif-plugged:f1dbc6da-e8f9-4962-ac4c-db69105689f9 for instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 on user Apr 14 03:20:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-e257177a-b19f-4795-94a9-bf2567ab9004 req-35aa9239-ba5b-4709-b732-5fd991fe2465 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028105 Apr 14 03:20:56 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 297/896] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:20:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:21:02 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:21:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c1024d06-0170-4db3-90cf-98c50833f378 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81" status: 200 len: 1769 microversion: 2.87 time: 0.474579 Apr 14 03:21:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 300/897] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:21:02 2023] GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81 => generated 1769 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] [instance: 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] HTTP exception thrown: Instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 could not be found. Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Request method failure captured: Apr 14 03:21:12 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 HTTP/1.1 Apr 14 03:21:12 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:21:12 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:21:12 user devstack@n-api.service[61663]: Connection: close Apr 14 03:21:12 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:21:12 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:21:12 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:21:12 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:21:12 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMTa2fhOuBRD1y6DqkiN9QXF90t4JE_dTcZ-R-cKT9RxfW8knXTrj7dsVdVCxSL055dW8uxzJoyNSW5_-gBxKfHA9i34yi08EAFzEWImpbRt09YegQfvoFc-xlZhEP1qSMB9I0tZL-yqrkgJmXeySF6Jk8ztHZp9WFBzrGeC2LhtZxc Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Project-Id: 0096d0892acf4d5f8a0fa290a18b451a Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Project-Name: tempest-SnapshotDataIntegrityTests-450991924 Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0096d0892acf4d5f8a0fa290a18b451a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0096d0892acf4d5f8a0fa290a18b451a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0096d0892acf4d5f8a0fa290a18b451a"}]}] Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Tenant: tempest-SnapshotDataIntegrityTests-450991924 Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Tenant-Id: 0096d0892acf4d5f8a0fa290a18b451a Apr 14 03:21:12 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-450991924 Apr 14 03:21:12 user devstack@n-api.service[61663]: X-User: tempest-SnapshotDataIntegrityTests-450991924-project-member Apr 14 03:21:12 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:21:12 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:21:12 user devstack@n-api.service[61663]: X-User-Id: ba8614e27c65428d92e4bf01969976e7 Apr 14 03:21:12 user devstack@n-api.service[61663]: X-User-Name: tempest-SnapshotDataIntegrityTests-450991924-project-member Apr 14 03:21:12 user devstack@n-api.service[61663]: method: > Apr 14 03:21:12 user devstack@n-api.service[61663]: exception: Instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 could not be found. Apr 14 03:21:12 user devstack@n-api.service[61663]: action_args: {'id': '9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4'} Apr 14 03:21:12 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 could not be found. Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 could not be found. Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 could not be found. Apr 14 03:21:12 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:21:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Returning 404 to user: Instance 9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:21:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-db7f3494-4099-452e-b639-3cce6d5b71a1 tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4" status: 404 len: 111 microversion: 2.1 time: 0.038810 Apr 14 03:21:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 301/898] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:21:12 2023] GET /compute/v2.1/servers/9816a2bd-cc75-48ed-a4ce-6c5d03ed61e4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:21:12 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f78da1b8-340a-48c5-8d50-48e7512b521d tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] Calling method '.version_select at 0x7ff11a3e0430>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:12 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:12 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=8 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f78da1b8-340a-48c5-8d50-48e7512b521d tempest-SnapshotDataIntegrityTests-450991924 tempest-SnapshotDataIntegrityTests-450991924-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1339724753" status: 202 len: 0 microversion: 2.1 time: 0.025705 Apr 14 03:21:12 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 298/899] 10.0.0.210 () {62 vars in 1355 bytes} [Fri Apr 14 03:21:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1339724753 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:21:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=14 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a132f7e8-62bc-45f0-8309-34ac6452b3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a132f7e8-62bc-45f0-8309-34ac6452b3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a132f7e8-62bc-45f0-8309-34ac6452b3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a132f7e8-62bc-45f0-8309-34ac6452b3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a132f7e8-62bc-45f0-8309-34ac6452b3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a132f7e8-62bc-45f0-8309-34ac6452b3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a132f7e8-62bc-45f0-8309-34ac6452b3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a132f7e8-62bc-45f0-8309-34ac6452b3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:20 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a132f7e8-62bc-45f0-8309-34ac6452b3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:21:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a132f7e8-62bc-45f0-8309-34ac6452b3b4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd" status: 200 len: 1545 microversion: 2.1 time: 0.173820 Apr 14 03:21:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 301/900] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:21:19 2023] GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd => generated 1545 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] HTTP exception thrown: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Request method failure captured: Apr 14 03:21:44 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 HTTP/1.1 Apr 14 03:21:44 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:21:44 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:21:44 user devstack@n-api.service[61663]: Connection: close Apr 14 03:21:44 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:21:44 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:21:44 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:21:44 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:21:44 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMEwNUgCimNYsQbBjNY65naesttf0DOIlIFsruFgOMPWUh9n__eJwNwzTfqsJ4pG6NctcV45i2hbejZLxJTqrHVdKL3k46KNVTFVtMghDaOPE_t4cqOxjSXOhHO_7WF7yR1Razi5RuuynO_-0mB1kL1eM-jN7S65s5A44Fbd5tq0Lwg Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Project-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4075885e26cb4adaad24d3ae6217fe35"}]}] Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Tenant-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:21:44 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:21:44 user devstack@n-api.service[61663]: X-User: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:21:44 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:21:44 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:21:44 user devstack@n-api.service[61663]: X-User-Id: 7dea23743ba945c4a9d539b8e277c653 Apr 14 03:21:44 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:21:44 user devstack@n-api.service[61663]: method: > Apr 14 03:21:44 user devstack@n-api.service[61663]: exception: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61663]: action_args: {'id': 'bc7bf9fb-977a-4015-8739-6fa66c1ec210'} Apr 14 03:21:44 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Returning 404 to user: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:21:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3aba8545-0358-4f04-b190-f26763be84bb tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 404 len: 111 microversion: 2.1 time: 0.034115 Apr 14 03:21:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 302/901] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:21:44 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] HTTP exception thrown: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Request method failure captured: Apr 14 03:21:44 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 HTTP/1.1 Apr 14 03:21:44 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:21:44 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:21:44 user devstack@n-api.service[61662]: Connection: close Apr 14 03:21:44 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:21:44 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:21:44 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:21:44 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:21:44 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEwNUgCimNYsQbBjNY65naesttf0DOIlIFsruFgOMPWUh9n__eJwNwzTfqsJ4pG6NctcV45i2hbejZLxJTqrHVdKL3k46KNVTFVtMghDaOPE_t4cqOxjSXOhHO_7WF7yR1Razi5RuuynO_-0mB1kL1eM-jN7S65s5A44Fbd5tq0Lwg Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Project-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Project-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4075885e26cb4adaad24d3ae6217fe35"}]}] Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Tenant: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Tenant-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:21:44 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:21:44 user devstack@n-api.service[61662]: X-User: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:21:44 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:21:44 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:21:44 user devstack@n-api.service[61662]: X-User-Id: 7dea23743ba945c4a9d539b8e277c653 Apr 14 03:21:44 user devstack@n-api.service[61662]: X-User-Name: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:21:44 user devstack@n-api.service[61662]: method: > Apr 14 03:21:44 user devstack@n-api.service[61662]: exception: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61662]: action_args: {'id': 'bc7bf9fb-977a-4015-8739-6fa66c1ec210'} Apr 14 03:21:44 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Returning 404 to user: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:21:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-bd702603-60a8-4e5b-9e29-e480f2e501cc tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 404 len: 111 microversion: 2.1 time: 0.036988 Apr 14 03:21:44 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 299/902] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:21:44 2023] DELETE /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: bc7bf9fb-977a-4015-8739-6fa66c1ec210] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] HTTP exception thrown: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Request method failure captured: Apr 14 03:21:44 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 HTTP/1.1 Apr 14 03:21:44 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:21:44 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:21:44 user devstack@n-api.service[61664]: Connection: close Apr 14 03:21:44 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:21:44 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:21:44 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:21:44 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:21:44 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEwNUgCimNYsQbBjNY65naesttf0DOIlIFsruFgOMPWUh9n__eJwNwzTfqsJ4pG6NctcV45i2hbejZLxJTqrHVdKL3k46KNVTFVtMghDaOPE_t4cqOxjSXOhHO_7WF7yR1Razi5RuuynO_-0mB1kL1eM-jN7S65s5A44Fbd5tq0Lwg Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Project-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4075885e26cb4adaad24d3ae6217fe35"}]}] Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Tenant-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:21:44 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:21:44 user devstack@n-api.service[61664]: X-User: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:21:44 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:21:44 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:21:44 user devstack@n-api.service[61664]: X-User-Id: 7dea23743ba945c4a9d539b8e277c653 Apr 14 03:21:44 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:21:44 user devstack@n-api.service[61664]: method: > Apr 14 03:21:44 user devstack@n-api.service[61664]: exception: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61664]: action_args: {'id': 'bc7bf9fb-977a-4015-8739-6fa66c1ec210'} Apr 14 03:21:44 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. Apr 14 03:21:44 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Returning 404 to user: Instance bc7bf9fb-977a-4015-8739-6fa66c1ec210 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:21:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6dd4ea46-af17-4d68-b413-28b3c40e3bfd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210" status: 404 len: 111 microversion: 2.1 time: 0.035046 Apr 14 03:21:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 302/903] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:21:44 2023] GET /compute/v2.1/servers/bc7bf9fb-977a-4015-8739-6fa66c1ec210 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7af3c17a-b0a8-4210-a3b6-9fc0bb0188e0 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7af3c17a-b0a8-4210-a3b6-9fc0bb0188e0 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 24d1359d-2dcd-46d7-90f3-3801df9be357] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af3c17a-b0a8-4210-a3b6-9fc0bb0188e0 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af3c17a-b0a8-4210-a3b6-9fc0bb0188e0 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af3c17a-b0a8-4210-a3b6-9fc0bb0188e0 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af3c17a-b0a8-4210-a3b6-9fc0bb0188e0 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af3c17a-b0a8-4210-a3b6-9fc0bb0188e0 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7af3c17a-b0a8-4210-a3b6-9fc0bb0188e0 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7af3c17a-b0a8-4210-a3b6-9fc0bb0188e0 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 24d1359d-2dcd-46d7-90f3-3801df9be357] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:21:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7af3c17a-b0a8-4210-a3b6-9fc0bb0188e0 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357" status: 204 len: 0 microversion: 2.1 time: 0.134609 Apr 14 03:21:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 303/904] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:21:44 2023] DELETE /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-2ebfc60d-e72a-42be-a726-dd33465bd1dd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-2ebfc60d-e72a-42be-a726-dd33465bd1dd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 24d1359d-2dcd-46d7-90f3-3801df9be357] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ebfc60d-e72a-42be-a726-dd33465bd1dd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ebfc60d-e72a-42be-a726-dd33465bd1dd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ebfc60d-e72a-42be-a726-dd33465bd1dd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ebfc60d-e72a-42be-a726-dd33465bd1dd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ebfc60d-e72a-42be-a726-dd33465bd1dd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2ebfc60d-e72a-42be-a726-dd33465bd1dd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-2ebfc60d-e72a-42be-a726-dd33465bd1dd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dea23743ba945c4a9d539b8e277c653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4075885e26cb4adaad24d3ae6217fe35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:21:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-2ebfc60d-e72a-42be-a726-dd33465bd1dd tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357" status: 200 len: 1543 microversion: 2.1 time: 0.240352 Apr 14 03:21:44 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 300/905] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:21:44 2023] GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357 => generated 1543 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f0e9008a-2fc6-4e0f-b38a-80f455934cf4 req-5f72be52-8290-49c7-bda8-ffc853438f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d1359d-2dcd-46d7-90f3-3801df9be357", "name": "network-vif-unplugged", "status": "completed", "tag": "6ea4c00e-5d4b-4375-9b8d-60177a6ec526"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f0e9008a-2fc6-4e0f-b38a-80f455934cf4 req-5f72be52-8290-49c7-bda8-ffc853438f8b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f0e9008a-2fc6-4e0f-b38a-80f455934cf4 req-5f72be52-8290-49c7-bda8-ffc853438f8b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f0e9008a-2fc6-4e0f-b38a-80f455934cf4 req-5f72be52-8290-49c7-bda8-ffc853438f8b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f0e9008a-2fc6-4e0f-b38a-80f455934cf4 req-5f72be52-8290-49c7-bda8-ffc853438f8b service nova] Creating event network-vif-unplugged:6ea4c00e-5d4b-4375-9b8d-60177a6ec526 for instance 24d1359d-2dcd-46d7-90f3-3801df9be357 on user Apr 14 03:21:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f0e9008a-2fc6-4e0f-b38a-80f455934cf4 req-5f72be52-8290-49c7-bda8-ffc853438f8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028828 Apr 14 03:21:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 303/906] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:21:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-fe119513-6cf7-4946-a602-fbcc4f2010e2 req-5f97359e-b11e-4b4c-a82d-9514978aa341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d1359d-2dcd-46d7-90f3-3801df9be357", "name": "network-vif-deleted", "tag": "6ea4c00e-5d4b-4375-9b8d-60177a6ec526"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:21:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-fe119513-6cf7-4946-a602-fbcc4f2010e2 req-5f97359e-b11e-4b4c-a82d-9514978aa341 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-fe119513-6cf7-4946-a602-fbcc4f2010e2 req-5f97359e-b11e-4b4c-a82d-9514978aa341 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-fe119513-6cf7-4946-a602-fbcc4f2010e2 req-5f97359e-b11e-4b4c-a82d-9514978aa341 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-fe119513-6cf7-4946-a602-fbcc4f2010e2 req-5f97359e-b11e-4b4c-a82d-9514978aa341 service nova] Creating event network-vif-deleted:6ea4c00e-5d4b-4375-9b8d-60177a6ec526 for instance 24d1359d-2dcd-46d7-90f3-3801df9be357 on user Apr 14 03:21:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-fe119513-6cf7-4946-a602-fbcc4f2010e2 req-5f97359e-b11e-4b4c-a82d-9514978aa341 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042772 Apr 14 03:21:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 304/907] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:21:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:21:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-512fabcc-6bdb-4153-80ca-e87661c96770 req-fb3c3755-14fb-44af-a621-125a977167aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d1359d-2dcd-46d7-90f3-3801df9be357", "name": "network-vif-plugged", "status": "completed", "tag": "6ea4c00e-5d4b-4375-9b8d-60177a6ec526"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:21:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-512fabcc-6bdb-4153-80ca-e87661c96770 req-fb3c3755-14fb-44af-a621-125a977167aa service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-512fabcc-6bdb-4153-80ca-e87661c96770 req-fb3c3755-14fb-44af-a621-125a977167aa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-512fabcc-6bdb-4153-80ca-e87661c96770 req-fb3c3755-14fb-44af-a621-125a977167aa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-512fabcc-6bdb-4153-80ca-e87661c96770 req-fb3c3755-14fb-44af-a621-125a977167aa service nova] Creating event network-vif-plugged:6ea4c00e-5d4b-4375-9b8d-60177a6ec526 for instance 24d1359d-2dcd-46d7-90f3-3801df9be357 on user Apr 14 03:21:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-512fabcc-6bdb-4153-80ca-e87661c96770 req-fb3c3755-14fb-44af-a621-125a977167aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029515 Apr 14 03:21:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 301/908] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:21:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-12a97dc2-f5b0-4b57-a25b-c4f583dcc47e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1195535830"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:21:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-12a97dc2-f5b0-4b57-a25b-c4f583dcc47e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-12a97dc2-f5b0-4b57-a25b-c4f583dcc47e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-12a97dc2-f5b0-4b57-a25b-c4f583dcc47e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-12a97dc2-f5b0-4b57-a25b-c4f583dcc47e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-12a97dc2-f5b0-4b57-a25b-c4f583dcc47e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-12a97dc2-f5b0-4b57-a25b-c4f583dcc47e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-12a97dc2-f5b0-4b57-a25b-c4f583dcc47e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:49 user devstack@n-api.service[61664]: INFO nova.network.security_group_api [None req-12a97dc2-f5b0-4b57-a25b-c4f583dcc47e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Removing security group 3c49bd70-79fa-413a-9fda-b0c8edbb1087 from port a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 Apr 14 03:21:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-12a97dc2-f5b0-4b57-a25b-c4f583dcc47e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/action" status: 202 len: 0 microversion: 2.1 time: 0.670203 Apr 14 03:21:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 304/909] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:21:49 2023] POST /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:21:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ab4dc81e-870b-4700-af75-e6fdceb98db4 req-65c9a034-eb31-4eaf-bfc4-a9be59fc52a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:21:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ab4dc81e-870b-4700-af75-e6fdceb98db4 req-65c9a034-eb31-4eaf-bfc4-a9be59fc52a8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ab4dc81e-870b-4700-af75-e6fdceb98db4 req-65c9a034-eb31-4eaf-bfc4-a9be59fc52a8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ab4dc81e-870b-4700-af75-e6fdceb98db4 req-65c9a034-eb31-4eaf-bfc4-a9be59fc52a8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ab4dc81e-870b-4700-af75-e6fdceb98db4 req-65c9a034-eb31-4eaf-bfc4-a9be59fc52a8 service nova] Creating event network-changed:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:21:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ab4dc81e-870b-4700-af75-e6fdceb98db4 req-65c9a034-eb31-4eaf-bfc4-a9be59fc52a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030769 Apr 14 03:21:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 305/910] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:21:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:21:50 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-cbb060be-b7dd-4c59-8e64-a61c3cb5640c req-601e9344-507c-4878-b625-0a2f3b9e83cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:21:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-cbb060be-b7dd-4c59-8e64-a61c3cb5640c req-601e9344-507c-4878-b625-0a2f3b9e83cd service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-cbb060be-b7dd-4c59-8e64-a61c3cb5640c req-601e9344-507c-4878-b625-0a2f3b9e83cd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-cbb060be-b7dd-4c59-8e64-a61c3cb5640c req-601e9344-507c-4878-b625-0a2f3b9e83cd service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-cbb060be-b7dd-4c59-8e64-a61c3cb5640c req-601e9344-507c-4878-b625-0a2f3b9e83cd service nova] Creating event network-changed:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:21:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-cbb060be-b7dd-4c59-8e64-a61c3cb5640c req-601e9344-507c-4878-b625-0a2f3b9e83cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028726 Apr 14 03:21:50 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 302/911] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:21:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:21:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6367bc65-9309-419f-a4a6-f21d79243a8c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6367bc65-9309-419f-a4a6-f21d79243a8c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6367bc65-9309-419f-a4a6-f21d79243a8c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6367bc65-9309-419f-a4a6-f21d79243a8c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6367bc65-9309-419f-a4a6-f21d79243a8c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6367bc65-9309-419f-a4a6-f21d79243a8c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6367bc65-9309-419f-a4a6-f21d79243a8c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6367bc65-9309-419f-a4a6-f21d79243a8c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:51 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-6367bc65-9309-419f-a4a6-f21d79243a8c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lazy-loading 'services' on Instance uuid 8cabfa40-3167-4f13-b6f3-4064d326f837 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:21:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6367bc65-9309-419f-a4a6-f21d79243a8c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments/96f437f9-4897-417a-95e3-097d2ff29476" status: 202 len: 0 microversion: 2.1 time: 0.167245 Apr 14 03:21:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 305/912] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:21:50 2023] DELETE /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments/96f437f9-4897-417a-95e3-097d2ff29476 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:21:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-451c5a16-04f8-433c-b810-d9314acdd250 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:21:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-451c5a16-04f8-433c-b810-d9314acdd250 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:21:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-451c5a16-04f8-433c-b810-d9314acdd250 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-451c5a16-04f8-433c-b810-d9314acdd250 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-451c5a16-04f8-433c-b810-d9314acdd250 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-451c5a16-04f8-433c-b810-d9314acdd250 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:21:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-451c5a16-04f8-433c-b810-d9314acdd250 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:21:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-451c5a16-04f8-433c-b810-d9314acdd250 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:21:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-451c5a16-04f8-433c-b810-d9314acdd250 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050584 Apr 14 03:21:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 306/913] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:21:51 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:02 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=8 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:02 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=12 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:03 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-05ff6a12-c479-4fce-8eb3-4426456f4eef tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:03 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-05ff6a12-c479-4fce-8eb3-4426456f4eef tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05ff6a12-c479-4fce-8eb3-4426456f4eef tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05ff6a12-c479-4fce-8eb3-4426456f4eef tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05ff6a12-c479-4fce-8eb3-4426456f4eef tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05ff6a12-c479-4fce-8eb3-4426456f4eef tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05ff6a12-c479-4fce-8eb3-4426456f4eef tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05ff6a12-c479-4fce-8eb3-4426456f4eef tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:03 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-05ff6a12-c479-4fce-8eb3-4426456f4eef tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:22:03 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-05ff6a12-c479-4fce-8eb3-4426456f4eef tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81" status: 204 len: 0 microversion: 2.87 time: 0.351366 Apr 14 03:22:03 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 303/914] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:22:02 2023] DELETE /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:22:03 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:22:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a3a140f5-a3be-4554-94ed-ef72a8ef22f6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81" status: 200 len: 1775 microversion: 2.87 time: 0.199852 Apr 14 03:22:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 306/915] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:22:03 2023] GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81 => generated 1775 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:22:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-696c0363-c343-474b-b0a8-6b56b8d3d7d0 req-045b2004-a899-499e-82d4-13be9d7a559e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-unplugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-696c0363-c343-474b-b0a8-6b56b8d3d7d0 req-045b2004-a899-499e-82d4-13be9d7a559e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-696c0363-c343-474b-b0a8-6b56b8d3d7d0 req-045b2004-a899-499e-82d4-13be9d7a559e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-696c0363-c343-474b-b0a8-6b56b8d3d7d0 req-045b2004-a899-499e-82d4-13be9d7a559e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-696c0363-c343-474b-b0a8-6b56b8d3d7d0 req-045b2004-a899-499e-82d4-13be9d7a559e service nova] Creating event network-vif-unplugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:22:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-696c0363-c343-474b-b0a8-6b56b8d3d7d0 req-045b2004-a899-499e-82d4-13be9d7a559e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052685 Apr 14 03:22:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 307/916] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:22:04 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-c403df20-b6b4-4ba7-9052-11c6c5d3c0cd req-d42e88c0-9950-405c-95b0-cbe86afeba96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-deleted", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c403df20-b6b4-4ba7-9052-11c6c5d3c0cd req-d42e88c0-9950-405c-95b0-cbe86afeba96 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c403df20-b6b4-4ba7-9052-11c6c5d3c0cd req-d42e88c0-9950-405c-95b0-cbe86afeba96 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:04 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c403df20-b6b4-4ba7-9052-11c6c5d3c0cd req-d42e88c0-9950-405c-95b0-cbe86afeba96 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-c403df20-b6b4-4ba7-9052-11c6c5d3c0cd req-d42e88c0-9950-405c-95b0-cbe86afeba96 service nova] Creating event network-vif-deleted:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:22:04 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-c403df20-b6b4-4ba7-9052-11c6c5d3c0cd req-d42e88c0-9950-405c-95b0-cbe86afeba96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029580 Apr 14 03:22:04 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 304/917] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-092ff57a-684a-4ad6-ad28-ebcceefd21c0 req-1f502419-507f-4ac6-9e7d-c9a498b7ba13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca85d0c8-d192-4bdf-b607-6fe637ad6f81", "name": "network-vif-plugged", "status": "completed", "tag": "eac1de6c-0025-4c84-a354-e1418e69740f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-092ff57a-684a-4ad6-ad28-ebcceefd21c0 req-1f502419-507f-4ac6-9e7d-c9a498b7ba13 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-092ff57a-684a-4ad6-ad28-ebcceefd21c0 req-1f502419-507f-4ac6-9e7d-c9a498b7ba13 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-092ff57a-684a-4ad6-ad28-ebcceefd21c0 req-1f502419-507f-4ac6-9e7d-c9a498b7ba13 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-092ff57a-684a-4ad6-ad28-ebcceefd21c0 req-1f502419-507f-4ac6-9e7d-c9a498b7ba13 service nova] Creating event network-vif-plugged:eac1de6c-0025-4c84-a354-e1418e69740f for instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 on user Apr 14 03:22:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-092ff57a-684a-4ad6-ad28-ebcceefd21c0 req-1f502419-507f-4ac6-9e7d-c9a498b7ba13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031458 Apr 14 03:22:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 307/918] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:20 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:20 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d78969b5-8ec7-466d-ad71-f116b21904d3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:20 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d78969b5-8ec7-466d-ad71-f116b21904d3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d78969b5-8ec7-466d-ad71-f116b21904d3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d78969b5-8ec7-466d-ad71-f116b21904d3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d78969b5-8ec7-466d-ad71-f116b21904d3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d78969b5-8ec7-466d-ad71-f116b21904d3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d78969b5-8ec7-466d-ad71-f116b21904d3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d78969b5-8ec7-466d-ad71-f116b21904d3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d78969b5-8ec7-466d-ad71-f116b21904d3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.113490 Apr 14 03:22:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 308/919] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:22:20 2023] GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd/os-interface => generated 283 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-434ca3c8-6f55-493e-a675-c84be6ff286e req-896ae658-5c78-4c58-a716-9fb7b3bc4d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b91538e-2a4b-453b-bfb3-5e569da0a3cd", "tag": "66cc3bdb-6829-4939-95c9-3549b7c39c65"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-434ca3c8-6f55-493e-a675-c84be6ff286e req-896ae658-5c78-4c58-a716-9fb7b3bc4d0a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-434ca3c8-6f55-493e-a675-c84be6ff286e req-896ae658-5c78-4c58-a716-9fb7b3bc4d0a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-434ca3c8-6f55-493e-a675-c84be6ff286e req-896ae658-5c78-4c58-a716-9fb7b3bc4d0a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-434ca3c8-6f55-493e-a675-c84be6ff286e req-896ae658-5c78-4c58-a716-9fb7b3bc4d0a service nova] Creating event network-changed:66cc3bdb-6829-4939-95c9-3549b7c39c65 for instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd on user Apr 14 03:22:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-434ca3c8-6f55-493e-a675-c84be6ff286e req-896ae658-5c78-4c58-a716-9fb7b3bc4d0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042140 Apr 14 03:22:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 305/920] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c42ce21a-8e4a-4467-8386-34d74fe292f1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c42ce21a-8e4a-4467-8386-34d74fe292f1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c42ce21a-8e4a-4467-8386-34d74fe292f1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c42ce21a-8e4a-4467-8386-34d74fe292f1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c42ce21a-8e4a-4467-8386-34d74fe292f1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c42ce21a-8e4a-4467-8386-34d74fe292f1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c42ce21a-8e4a-4467-8386-34d74fe292f1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c42ce21a-8e4a-4467-8386-34d74fe292f1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c42ce21a-8e4a-4467-8386-34d74fe292f1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd/ips" status: 200 len: 109 microversion: 2.1 time: 0.093039 Apr 14 03:22:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 308/921] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 03:22:21 2023] GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd/ips => generated 109 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:21 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Invalid volume: volume c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 is already attached to instances: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 Apr 14 03:22:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:22:21 user devstack@n-api.service[61663]: request: POST /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd/os-volume_attachments HTTP/1.1 Apr 14 03:22:21 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:22:21 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:22:21 user devstack@n-api.service[61663]: Connection: close Apr 14 03:22:21 user devstack@n-api.service[61663]: Content-Length: 74 Apr 14 03:22:21 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:22:21 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:22:21 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:22:21 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:22:21 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:22:21 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:22:21 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:22:21 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:22:21 user devstack@n-api.service[61663]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:22:21 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:22:21 user devstack@n-api.service[61663]: Apr 14 03:22:21 user devstack@n-api.service[61663]: {"volumeAttachment": {"volumeId": "c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36"}} Apr 14 03:22:21 user devstack@n-api.service[61663]: method: > Apr 14 03:22:21 user devstack@n-api.service[61663]: exception: Invalid volume: volume c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 is already attached to instances: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 Apr 14 03:22:21 user devstack@n-api.service[61663]: action_args: {'server_id': '9b91538e-2a4b-453b-bfb3-5e569da0a3cd', 'body': {'volumeAttachment': {'volumeId': 'c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36'}}} Apr 14 03:22:21 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 is already attached to instances: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 is already attached to instances: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 is already attached to instances: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 Apr 14 03:22:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 400 to user: Invalid volume: volume c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 is already attached to instances: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:22:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ad433fd6-9306-496f-b74e-4981314a4e8c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103359 Apr 14 03:22:21 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 309/922] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:22:21 2023] POST /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-db5dbb8a-cfa6-4cbc-8539-90a5cca7e716 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-db5dbb8a-cfa6-4cbc-8539-90a5cca7e716 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-db5dbb8a-cfa6-4cbc-8539-90a5cca7e716 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-db5dbb8a-cfa6-4cbc-8539-90a5cca7e716 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-db5dbb8a-cfa6-4cbc-8539-90a5cca7e716 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-db5dbb8a-cfa6-4cbc-8539-90a5cca7e716 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-db5dbb8a-cfa6-4cbc-8539-90a5cca7e716 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-db5dbb8a-cfa6-4cbc-8539-90a5cca7e716 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:21 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-db5dbb8a-cfa6-4cbc-8539-90a5cca7e716 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:22:21 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-db5dbb8a-cfa6-4cbc-8539-90a5cca7e716 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd" status: 204 len: 0 microversion: 2.1 time: 0.123874 Apr 14 03:22:21 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 306/923] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:22:21 2023] DELETE /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a94a6217-f875-4656-b1fc-382c85ac084d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a94a6217-f875-4656-b1fc-382c85ac084d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a94a6217-f875-4656-b1fc-382c85ac084d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a94a6217-f875-4656-b1fc-382c85ac084d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a94a6217-f875-4656-b1fc-382c85ac084d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a94a6217-f875-4656-b1fc-382c85ac084d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a94a6217-f875-4656-b1fc-382c85ac084d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a94a6217-f875-4656-b1fc-382c85ac084d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:22 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-aef221a6-8199-4fc6-ab86-6d5231c8d2c9 req-ab7d96d6-78ab-4187-bcc9-37563b0d25da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b91538e-2a4b-453b-bfb3-5e569da0a3cd", "name": "network-vif-unplugged", "status": "completed", "tag": "66cc3bdb-6829-4939-95c9-3549b7c39c65"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aef221a6-8199-4fc6-ab86-6d5231c8d2c9 req-ab7d96d6-78ab-4187-bcc9-37563b0d25da service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aef221a6-8199-4fc6-ab86-6d5231c8d2c9 req-ab7d96d6-78ab-4187-bcc9-37563b0d25da service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aef221a6-8199-4fc6-ab86-6d5231c8d2c9 req-ab7d96d6-78ab-4187-bcc9-37563b0d25da service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:22 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a94a6217-f875-4656-b1fc-382c85ac084d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:22:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-aef221a6-8199-4fc6-ab86-6d5231c8d2c9 req-ab7d96d6-78ab-4187-bcc9-37563b0d25da service nova] Creating event network-vif-unplugged:66cc3bdb-6829-4939-95c9-3549b7c39c65 for instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd on user Apr 14 03:22:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a94a6217-f875-4656-b1fc-382c85ac084d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd" status: 200 len: 1551 microversion: 2.1 time: 0.268181 Apr 14 03:22:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 309/924] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:22:21 2023] GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd => generated 1551 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:22:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-aef221a6-8199-4fc6-ab86-6d5231c8d2c9 req-ab7d96d6-78ab-4187-bcc9-37563b0d25da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038474 Apr 14 03:22:22 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 310/925] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:23 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-d25ea8d7-1fe3-40c3-ae92-f0b4f063fa48 req-f4ca9b78-98a7-4857-92b7-3f600086d758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b91538e-2a4b-453b-bfb3-5e569da0a3cd", "name": "network-vif-deleted", "tag": "66cc3bdb-6829-4939-95c9-3549b7c39c65"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d25ea8d7-1fe3-40c3-ae92-f0b4f063fa48 req-f4ca9b78-98a7-4857-92b7-3f600086d758 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d25ea8d7-1fe3-40c3-ae92-f0b4f063fa48 req-f4ca9b78-98a7-4857-92b7-3f600086d758 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d25ea8d7-1fe3-40c3-ae92-f0b4f063fa48 req-f4ca9b78-98a7-4857-92b7-3f600086d758 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:23 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-d25ea8d7-1fe3-40c3-ae92-f0b4f063fa48 req-f4ca9b78-98a7-4857-92b7-3f600086d758 service nova] Creating event network-vif-deleted:66cc3bdb-6829-4939-95c9-3549b7c39c65 for instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd on user Apr 14 03:22:23 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-d25ea8d7-1fe3-40c3-ae92-f0b4f063fa48 req-f4ca9b78-98a7-4857-92b7-3f600086d758 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028044 Apr 14 03:22:23 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 307/926] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:24 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a70c410f-8bec-4fa4-9793-7979d99c4ae8 req-87b8eeab-46d9-4fd9-b1df-25fc0f2335d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b91538e-2a4b-453b-bfb3-5e569da0a3cd", "name": "network-vif-plugged", "status": "completed", "tag": "66cc3bdb-6829-4939-95c9-3549b7c39c65"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a70c410f-8bec-4fa4-9793-7979d99c4ae8 req-87b8eeab-46d9-4fd9-b1df-25fc0f2335d4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a70c410f-8bec-4fa4-9793-7979d99c4ae8 req-87b8eeab-46d9-4fd9-b1df-25fc0f2335d4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a70c410f-8bec-4fa4-9793-7979d99c4ae8 req-87b8eeab-46d9-4fd9-b1df-25fc0f2335d4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a70c410f-8bec-4fa4-9793-7979d99c4ae8 req-87b8eeab-46d9-4fd9-b1df-25fc0f2335d4 service nova] Creating event network-vif-plugged:66cc3bdb-6829-4939-95c9-3549b7c39c65 for instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd on user Apr 14 03:22:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a70c410f-8bec-4fa4-9793-7979d99c4ae8 req-87b8eeab-46d9-4fd9-b1df-25fc0f2335d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038998 Apr 14 03:22:24 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 310/927] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=12 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 24d1359d-2dcd-46d7-90f3-3801df9be357] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] HTTP exception thrown: Instance 24d1359d-2dcd-46d7-90f3-3801df9be357 could not be found. Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Request method failure captured: Apr 14 03:22:34 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357 HTTP/1.1 Apr 14 03:22:34 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:22:34 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:22:34 user devstack@n-api.service[61663]: Connection: close Apr 14 03:22:34 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:22:34 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:22:34 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:22:34 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:22:34 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMEwNUgCimNYsQbBjNY65naesttf0DOIlIFsruFgOMPWUh9n__eJwNwzTfqsJ4pG6NctcV45i2hbejZLxJTqrHVdKL3k46KNVTFVtMghDaOPE_t4cqOxjSXOhHO_7WF7yR1Razi5RuuynO_-0mB1kL1eM-jN7S65s5A44Fbd5tq0Lwg Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Project-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4075885e26cb4adaad24d3ae6217fe35"}]}] Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Tenant-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:22:34 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:22:34 user devstack@n-api.service[61663]: X-User: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:22:34 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:22:34 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:22:34 user devstack@n-api.service[61663]: X-User-Id: 7dea23743ba945c4a9d539b8e277c653 Apr 14 03:22:34 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:22:34 user devstack@n-api.service[61663]: method: > Apr 14 03:22:34 user devstack@n-api.service[61663]: exception: Instance 24d1359d-2dcd-46d7-90f3-3801df9be357 could not be found. Apr 14 03:22:34 user devstack@n-api.service[61663]: action_args: {'id': '24d1359d-2dcd-46d7-90f3-3801df9be357'} Apr 14 03:22:34 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d1359d-2dcd-46d7-90f3-3801df9be357 could not be found. Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d1359d-2dcd-46d7-90f3-3801df9be357 could not be found. Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d1359d-2dcd-46d7-90f3-3801df9be357 could not be found. Apr 14 03:22:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Returning 404 to user: Instance 24d1359d-2dcd-46d7-90f3-3801df9be357 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:22:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7d38c5d4-2073-4fd9-9083-95d9c11e775a tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357" status: 404 len: 111 microversion: 2.1 time: 0.033794 Apr 14 03:22:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 311/928] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:22:34 2023] GET /compute/v2.1/servers/24d1359d-2dcd-46d7-90f3-3801df9be357 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-0af74190-701f-4369-aa1e-6443c8cf813c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-0af74190-701f-4369-aa1e-6443c8cf813c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0af74190-701f-4369-aa1e-6443c8cf813c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0af74190-701f-4369-aa1e-6443c8cf813c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0af74190-701f-4369-aa1e-6443c8cf813c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0af74190-701f-4369-aa1e-6443c8cf813c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0af74190-701f-4369-aa1e-6443c8cf813c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0af74190-701f-4369-aa1e-6443c8cf813c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=12 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-0af74190-701f-4369-aa1e-6443c8cf813c tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064754 Apr 14 03:22:41 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 308/929] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:22:41 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:22:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] HTTP exception thrown: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Request method failure captured: Apr 14 03:22:41 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 HTTP/1.1 Apr 14 03:22:41 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:22:41 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:22:41 user devstack@n-api.service[61664]: Connection: close Apr 14 03:22:41 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:22:41 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:22:41 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:22:41 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:22:41 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMEwNUgCimNYsQbBjNY65naesttf0DOIlIFsruFgOMPWUh9n__eJwNwzTfqsJ4pG6NctcV45i2hbejZLxJTqrHVdKL3k46KNVTFVtMghDaOPE_t4cqOxjSXOhHO_7WF7yR1Razi5RuuynO_-0mB1kL1eM-jN7S65s5A44Fbd5tq0Lwg Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Project-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4075885e26cb4adaad24d3ae6217fe35"}]}] Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Tenant-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:22:41 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:22:41 user devstack@n-api.service[61664]: X-User: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:22:41 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:22:41 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:22:41 user devstack@n-api.service[61664]: X-User-Id: 7dea23743ba945c4a9d539b8e277c653 Apr 14 03:22:41 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:22:41 user devstack@n-api.service[61664]: method: > Apr 14 03:22:41 user devstack@n-api.service[61664]: exception: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:22:41 user devstack@n-api.service[61664]: action_args: {'id': '6bb082bc-0c74-4149-9bd0-ceb09d7764d4'} Apr 14 03:22:41 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:22:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Returning 404 to user: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:22:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8360d26e-6ec8-4c33-bf00-ea4c4ba9d8f5 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 404 len: 111 microversion: 2.1 time: 0.048461 Apr 14 03:22:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:41 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 311/930] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:22:41 2023] DELETE /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:22:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] [instance: 6bb082bc-0c74-4149-9bd0-ceb09d7764d4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] HTTP exception thrown: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Request method failure captured: Apr 14 03:22:41 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 HTTP/1.1 Apr 14 03:22:41 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:22:41 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:22:41 user devstack@n-api.service[61662]: Connection: close Apr 14 03:22:41 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:22:41 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:22:41 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:22:41 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:22:41 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMEwNUgCimNYsQbBjNY65naesttf0DOIlIFsruFgOMPWUh9n__eJwNwzTfqsJ4pG6NctcV45i2hbejZLxJTqrHVdKL3k46KNVTFVtMghDaOPE_t4cqOxjSXOhHO_7WF7yR1Razi5RuuynO_-0mB1kL1eM-jN7S65s5A44Fbd5tq0Lwg Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Project-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Project-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4075885e26cb4adaad24d3ae6217fe35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4075885e26cb4adaad24d3ae6217fe35"}]}] Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Tenant: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Tenant-Id: 4075885e26cb4adaad24d3ae6217fe35 Apr 14 03:22:41 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848627478 Apr 14 03:22:41 user devstack@n-api.service[61662]: X-User: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:22:41 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:22:41 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:22:41 user devstack@n-api.service[61662]: X-User-Id: 7dea23743ba945c4a9d539b8e277c653 Apr 14 03:22:41 user devstack@n-api.service[61662]: X-User-Name: tempest-ServerActionsTestJSON-1848627478-project-member Apr 14 03:22:41 user devstack@n-api.service[61662]: method: > Apr 14 03:22:41 user devstack@n-api.service[61662]: exception: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:22:41 user devstack@n-api.service[61662]: action_args: {'id': '6bb082bc-0c74-4149-9bd0-ceb09d7764d4'} Apr 14 03:22:41 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. Apr 14 03:22:41 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Returning 404 to user: Instance 6bb082bc-0c74-4149-9bd0-ceb09d7764d4 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:22:41 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-cf2a2d47-145f-4b1d-b887-942b716b2ed2 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4" status: 404 len: 111 microversion: 2.1 time: 0.030400 Apr 14 03:22:41 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 309/931] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:22:41 2023] GET /compute/v2.1/servers/6bb082bc-0c74-4149-9bd0-ceb09d7764d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:22:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-01b1e98a-26d6-476d-9193-af1709d88063 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] Calling method '.version_select at 0x7ff11a753370>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-01b1e98a-26d6-476d-9193-af1709d88063 tempest-ServerActionsTestJSON-1848627478 tempest-ServerActionsTestJSON-1848627478-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-368632906" status: 202 len: 0 microversion: 2.1 time: 0.035114 Apr 14 03:22:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 312/932] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 03:22:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-368632906 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:22:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] HTTP exception thrown: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 is not attached to volume 96f437f9-4897-417a-95e3-097d2ff29476 Apr 14 03:22:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Request method failure captured: Apr 14 03:22:41 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments/96f437f9-4897-417a-95e3-097d2ff29476 HTTP/1.1 Apr 14 03:22:41 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:22:41 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:22:41 user devstack@n-api.service[61663]: Connection: close Apr 14 03:22:41 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:22:41 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:22:41 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:22:41 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:22:41 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMXR-kr9xncbKooOUYTDDwxQf6qU6zMY9yLTZpzwPQK4qB9Nshrwjk8wTlNW5n1Cs6HzH56l9wS6C0lQTUfYT459LjMwBhWh4a7viw-lRuTulzvveTDpEpmb9Xa7HRG6FX0dG1VUx4IOd2Th1Q9G3-Qb76Jcva2Oq8xgy-1pHf9G3cI Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Project-Id: 0bd451b3f6734fe3ac0a8e8a853bb9eb Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}] Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Tenant: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Tenant-Id: 0bd451b3f6734fe3ac0a8e8a853bb9eb Apr 14 03:22:41 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:22:41 user devstack@n-api.service[61663]: X-User: tempest-TestMinimumBasicScenario-144187586-project-member Apr 14 03:22:41 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:22:41 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:22:41 user devstack@n-api.service[61663]: X-User-Id: 12199a43298942898a2e694ee2c5230e Apr 14 03:22:41 user devstack@n-api.service[61663]: X-User-Name: tempest-TestMinimumBasicScenario-144187586-project-member Apr 14 03:22:41 user devstack@n-api.service[61663]: method: > Apr 14 03:22:41 user devstack@n-api.service[61663]: exception: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 is not attached to volume 96f437f9-4897-417a-95e3-097d2ff29476 Apr 14 03:22:41 user devstack@n-api.service[61663]: action_args: {'server_id': '8cabfa40-3167-4f13-b6f3-4064d326f837', 'id': '96f437f9-4897-417a-95e3-097d2ff29476'} Apr 14 03:22:41 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 96f437f9-4897-417a-95e3-097d2ff29476. Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 is not attached to volume 96f437f9-4897-417a-95e3-097d2ff29476 Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 is not attached to volume 96f437f9-4897-417a-95e3-097d2ff29476 Apr 14 03:22:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Returning 404 to user: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 is not attached to volume 96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:22:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7768e9a6-ba2e-4884-b8fc-12a2e3fa0619 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments/96f437f9-4897-417a-95e3-097d2ff29476" status: 404 len: 154 microversion: 2.1 time: 0.155099 Apr 14 03:22:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 312/933] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:22:41 2023] DELETE /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837/os-volume_attachments/96f437f9-4897-417a-95e3-097d2ff29476 => generated 154 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:22:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c2391a35-130f-410d-ac8e-cf4410dd24ff tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:44 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c2391a35-130f-410d-ac8e-cf4410dd24ff tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2391a35-130f-410d-ac8e-cf4410dd24ff tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2391a35-130f-410d-ac8e-cf4410dd24ff tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2391a35-130f-410d-ac8e-cf4410dd24ff tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2391a35-130f-410d-ac8e-cf4410dd24ff tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2391a35-130f-410d-ac8e-cf4410dd24ff tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2391a35-130f-410d-ac8e-cf4410dd24ff tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:44 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c2391a35-130f-410d-ac8e-cf4410dd24ff tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:22:45 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c2391a35-130f-410d-ac8e-cf4410dd24ff tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 204 len: 0 microversion: 2.1 time: 0.122837 Apr 14 03:22:45 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 310/934] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:22:44 2023] DELETE /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:22:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a22f2ced-c7bc-4c96-bce0-5b5c6ec1f1ab tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:45 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a22f2ced-c7bc-4c96-bce0-5b5c6ec1f1ab tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a22f2ced-c7bc-4c96-bce0-5b5c6ec1f1ab tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a22f2ced-c7bc-4c96-bce0-5b5c6ec1f1ab tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a22f2ced-c7bc-4c96-bce0-5b5c6ec1f1ab tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a22f2ced-c7bc-4c96-bce0-5b5c6ec1f1ab tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a22f2ced-c7bc-4c96-bce0-5b5c6ec1f1ab tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a22f2ced-c7bc-4c96-bce0-5b5c6ec1f1ab tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:45 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a22f2ced-c7bc-4c96-bce0-5b5c6ec1f1ab tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:22:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a22f2ced-c7bc-4c96-bce0-5b5c6ec1f1ab tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 200 len: 1540 microversion: 2.1 time: 0.189222 Apr 14 03:22:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 313/935] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:22:45 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 1540 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:22:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-808b05c0-370f-4bf2-bf0b-265054bdf3f8 req-57b90542-8864-415c-8cbe-f2af005f2c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "name": "network-vif-unplugged", "status": "completed", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-808b05c0-370f-4bf2-bf0b-265054bdf3f8 req-57b90542-8864-415c-8cbe-f2af005f2c8b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-808b05c0-370f-4bf2-bf0b-265054bdf3f8 req-57b90542-8864-415c-8cbe-f2af005f2c8b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-808b05c0-370f-4bf2-bf0b-265054bdf3f8 req-57b90542-8864-415c-8cbe-f2af005f2c8b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-808b05c0-370f-4bf2-bf0b-265054bdf3f8 req-57b90542-8864-415c-8cbe-f2af005f2c8b service nova] Creating event network-vif-unplugged:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:22:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-808b05c0-370f-4bf2-bf0b-265054bdf3f8 req-57b90542-8864-415c-8cbe-f2af005f2c8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032754 Apr 14 03:22:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 313/936] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:46 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-788b4ffa-1863-4858-b11c-1a8c5a561531 req-d0487823-24f8-44e5-8189-3324ea89c2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "name": "network-vif-deleted", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-788b4ffa-1863-4858-b11c-1a8c5a561531 req-d0487823-24f8-44e5-8189-3324ea89c2ea service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-788b4ffa-1863-4858-b11c-1a8c5a561531 req-d0487823-24f8-44e5-8189-3324ea89c2ea service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-788b4ffa-1863-4858-b11c-1a8c5a561531 req-d0487823-24f8-44e5-8189-3324ea89c2ea service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-788b4ffa-1863-4858-b11c-1a8c5a561531 req-d0487823-24f8-44e5-8189-3324ea89c2ea service nova] Creating event network-vif-deleted:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:22:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-788b4ffa-1863-4858-b11c-1a8c5a561531 req-d0487823-24f8-44e5-8189-3324ea89c2ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 Apr 14 03:22:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 311/937] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-eeae9fbd-e70c-4f02-aa55-b1f7a87473e9 req-d34c24ef-070d-4f25-8e7c-76ba6b69ea13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cabfa40-3167-4f13-b6f3-4064d326f837", "name": "network-vif-plugged", "status": "completed", "tag": "a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-eeae9fbd-e70c-4f02-aa55-b1f7a87473e9 req-d34c24ef-070d-4f25-8e7c-76ba6b69ea13 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-eeae9fbd-e70c-4f02-aa55-b1f7a87473e9 req-d34c24ef-070d-4f25-8e7c-76ba6b69ea13 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-eeae9fbd-e70c-4f02-aa55-b1f7a87473e9 req-d34c24ef-070d-4f25-8e7c-76ba6b69ea13 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-eeae9fbd-e70c-4f02-aa55-b1f7a87473e9 req-d34c24ef-070d-4f25-8e7c-76ba6b69ea13 service nova] Creating event network-vif-plugged:a478a9ea-0fba-4d3e-8fa1-9ba6371c01a0 for instance 8cabfa40-3167-4f13-b6f3-4064d326f837 on user Apr 14 03:22:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-eeae9fbd-e70c-4f02-aa55-b1f7a87473e9 req-d34c24ef-070d-4f25-8e7c-76ba6b69ea13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029272 Apr 14 03:22:47 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 314/938] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:53 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: ca85d0c8-d192-4bdf-b607-6fe637ad6f81] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] HTTP exception thrown: Instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 could not be found. Apr 14 03:22:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Request method failure captured: Apr 14 03:22:53 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81 HTTP/1.1 Apr 14 03:22:53 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:22:53 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:22:53 user devstack@n-api.service[61663]: Connection: close Apr 14 03:22:53 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:22:53 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:22:53 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:22:53 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:22:53 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMLY-YMbgZL_GnErger3TQUrNUvk6Tg13Ck3FfGw2YgySl0eFpU2FoFqJ_C6D4mzxWVrJyAllp_09LWRlF9QNgz3po_4bp45hDdOXsfdu44mxFFVRqac5yIQ1zp1IhvbseJpySeO9Lb8OBAU8ohShItEGLEdX-baXuyHupuHs7HYmHw Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Project-Id: bd2c5b2aafaf4ca7bf62e988ac726658 Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd2c5b2aafaf4ca7bf62e988ac726658"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd2c5b2aafaf4ca7bf62e988ac726658"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd2c5b2aafaf4ca7bf62e988ac726658"}]}] Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Tenant-Id: bd2c5b2aafaf4ca7bf62e988ac726658 Apr 14 03:22:53 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:22:53 user devstack@n-api.service[61663]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member Apr 14 03:22:53 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:22:53 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:22:53 user devstack@n-api.service[61663]: X-User-Id: d666936eb0ee43a2ad9e17a12e6e273d Apr 14 03:22:53 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member Apr 14 03:22:53 user devstack@n-api.service[61663]: method: > Apr 14 03:22:53 user devstack@n-api.service[61663]: exception: Instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 could not be found. Apr 14 03:22:53 user devstack@n-api.service[61663]: action_args: {'id': 'ca85d0c8-d192-4bdf-b607-6fe637ad6f81'} Apr 14 03:22:53 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 could not be found. Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 could not be found. Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 could not be found. Apr 14 03:22:53 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:22:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Returning 404 to user: Instance ca85d0c8-d192-4bdf-b607-6fe637ad6f81 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:22:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1c54636d-b16b-4b80-9ce7-e162c5e1ade7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81" status: 404 len: 111 microversion: 2.87 time: 0.035388 Apr 14 03:22:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 314/939] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:22:53 2023] GET /compute/v2.1/servers/ca85d0c8-d192-4bdf-b607-6fe637ad6f81 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:22:53 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-7c25ce80-fa68-469d-a87b-4b86a13d2cfc tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:53 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-7c25ce80-fa68-469d-a87b-4b86a13d2cfc tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: bd5b587d-58a9-411b-a755-67adaa6bd6c9] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7c25ce80-fa68-469d-a87b-4b86a13d2cfc tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7c25ce80-fa68-469d-a87b-4b86a13d2cfc tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7c25ce80-fa68-469d-a87b-4b86a13d2cfc tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7c25ce80-fa68-469d-a87b-4b86a13d2cfc tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7c25ce80-fa68-469d-a87b-4b86a13d2cfc tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7c25ce80-fa68-469d-a87b-4b86a13d2cfc tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:53 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-7c25ce80-fa68-469d-a87b-4b86a13d2cfc tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: bd5b587d-58a9-411b-a755-67adaa6bd6c9] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:22:53 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-7c25ce80-fa68-469d-a87b-4b86a13d2cfc tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9" status: 204 len: 0 microversion: 2.87 time: 0.126228 Apr 14 03:22:53 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 312/940] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:22:53 2023] DELETE /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:22:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:22:53 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: bd5b587d-58a9-411b-a755-67adaa6bd6c9] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:22:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:54 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:22:54 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:22:54 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:22:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8222718a-cc88-4b40-9415-fb92c730a920 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9" status: 200 len: 1697 microversion: 2.87 time: 0.224816 Apr 14 03:22:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 315/941] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:22:53 2023] GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9 => generated 1697 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:22:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-7b9598d4-e309-4ce2-b148-f38e0c1a20d3 req-d5229421-8bb1-4153-a4f2-0d30640e571c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5b587d-58a9-411b-a755-67adaa6bd6c9", "name": "network-vif-unplugged", "status": "completed", "tag": "52fd899f-496c-41d3-a9e0-6574a27e3b1b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7b9598d4-e309-4ce2-b148-f38e0c1a20d3 req-d5229421-8bb1-4153-a4f2-0d30640e571c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7b9598d4-e309-4ce2-b148-f38e0c1a20d3 req-d5229421-8bb1-4153-a4f2-0d30640e571c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7b9598d4-e309-4ce2-b148-f38e0c1a20d3 req-d5229421-8bb1-4153-a4f2-0d30640e571c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-7b9598d4-e309-4ce2-b148-f38e0c1a20d3 req-d5229421-8bb1-4153-a4f2-0d30640e571c service nova] Creating event network-vif-unplugged:52fd899f-496c-41d3-a9e0-6574a27e3b1b for instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 on user Apr 14 03:22:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-7b9598d4-e309-4ce2-b148-f38e0c1a20d3 req-d5229421-8bb1-4153-a4f2-0d30640e571c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029824 Apr 14 03:22:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 315/942] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:22:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-45fc63b8-a2c8-4e2a-918a-6ae317349ed4 req-16c359d6-deea-4739-b0f0-6ee409638d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5b587d-58a9-411b-a755-67adaa6bd6c9", "name": "network-vif-plugged", "status": "completed", "tag": "52fd899f-496c-41d3-a9e0-6574a27e3b1b"}, {"server_uuid": "bd5b587d-58a9-411b-a755-67adaa6bd6c9", "name": "network-vif-plugged", "status": "completed", "tag": "52fd899f-496c-41d3-a9e0-6574a27e3b1b"}, {"server_uuid": "bd5b587d-58a9-411b-a755-67adaa6bd6c9", "name": "network-vif-plugged", "status": "completed", "tag": "52fd899f-496c-41d3-a9e0-6574a27e3b1b"}, {"server_uuid": "bd5b587d-58a9-411b-a755-67adaa6bd6c9", "name": "network-vif-plugged", "status": "completed", "tag": "52fd899f-496c-41d3-a9e0-6574a27e3b1b"}, {"server_uuid": "bd5b587d-58a9-411b-a755-67adaa6bd6c9", "name": "network-vif-deleted", "tag": "52fd899f-496c-41d3-a9e0-6574a27e3b1b"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:22:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-45fc63b8-a2c8-4e2a-918a-6ae317349ed4 req-16c359d6-deea-4739-b0f0-6ee409638d4b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:22:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-45fc63b8-a2c8-4e2a-918a-6ae317349ed4 req-16c359d6-deea-4739-b0f0-6ee409638d4b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:22:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-45fc63b8-a2c8-4e2a-918a-6ae317349ed4 req-16c359d6-deea-4739-b0f0-6ee409638d4b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:22:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-45fc63b8-a2c8-4e2a-918a-6ae317349ed4 req-16c359d6-deea-4739-b0f0-6ee409638d4b service nova] Creating event network-vif-plugged:52fd899f-496c-41d3-a9e0-6574a27e3b1b for instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 on user Apr 14 03:22:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-45fc63b8-a2c8-4e2a-918a-6ae317349ed4 req-16c359d6-deea-4739-b0f0-6ee409638d4b service nova] Creating event network-vif-plugged:52fd899f-496c-41d3-a9e0-6574a27e3b1b for instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 on user Apr 14 03:22:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-45fc63b8-a2c8-4e2a-918a-6ae317349ed4 req-16c359d6-deea-4739-b0f0-6ee409638d4b service nova] Creating event network-vif-plugged:52fd899f-496c-41d3-a9e0-6574a27e3b1b for instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 on user Apr 14 03:22:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-45fc63b8-a2c8-4e2a-918a-6ae317349ed4 req-16c359d6-deea-4739-b0f0-6ee409638d4b service nova] Creating event network-vif-plugged:52fd899f-496c-41d3-a9e0-6574a27e3b1b for instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 on user Apr 14 03:22:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-45fc63b8-a2c8-4e2a-918a-6ae317349ed4 req-16c359d6-deea-4739-b0f0-6ee409638d4b service nova] Creating event network-vif-deleted:52fd899f-496c-41d3-a9e0-6574a27e3b1b for instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 on user Apr 14 03:22:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-45fc63b8-a2c8-4e2a-918a-6ae317349ed4 req-16c359d6-deea-4739-b0f0-6ee409638d4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.034958 Apr 14 03:22:56 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 313/943] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:22:56 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1553175621", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=16 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] validate_networks() for None {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Getting quotas for project 1ccb5ceb9f7641a9b6265de1f3c38c89. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Getting quotas for user 85a2f927a9b94b6a8e9d91932bab0af6 and project 1ccb5ceb9f7641a9b6265de1f3c38c89. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:23:07 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] [instance: 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:23:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-31c8b5be-ae0f-4254-b233-9000830b21c7 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.432627 Apr 14 03:23:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 316/944] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:23:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:23:07 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:07 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=14 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-395e6b19-2917-4a43-abd8-bd26e52ed7b4 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:07 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-395e6b19-2917-4a43-abd8-bd26e52ed7b4 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] [instance: 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:23:08 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-395e6b19-2917-4a43-abd8-bd26e52ed7b4 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a2f927a9b94b6a8e9d91932bab0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccb5ceb9f7641a9b6265de1f3c38c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:23:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-395e6b19-2917-4a43-abd8-bd26e52ed7b4 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420" status: 200 len: 1209 microversion: 2.1 time: 0.532844 Apr 14 03:23:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 316/945] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:23:07 2023] GET /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 => generated 1209 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:23:11 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:11 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:11 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-47205489-2641-4948-86b7-b3e70acc4e12 req-b7233728-87ec-49a3-bbb9-dd3fd1ebcc11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420", "tag": "587e1221-a4b5-4e33-8621-2606be640411"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-47205489-2641-4948-86b7-b3e70acc4e12 req-b7233728-87ec-49a3-bbb9-dd3fd1ebcc11 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-47205489-2641-4948-86b7-b3e70acc4e12 req-b7233728-87ec-49a3-bbb9-dd3fd1ebcc11 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:11 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-47205489-2641-4948-86b7-b3e70acc4e12 req-b7233728-87ec-49a3-bbb9-dd3fd1ebcc11 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:11 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-47205489-2641-4948-86b7-b3e70acc4e12 req-b7233728-87ec-49a3-bbb9-dd3fd1ebcc11 service nova] Creating event network-changed:587e1221-a4b5-4e33-8621-2606be640411 for instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 on user Apr 14 03:23:11 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-47205489-2641-4948-86b7-b3e70acc4e12 req-b7233728-87ec-49a3-bbb9-dd3fd1ebcc11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041525 Apr 14 03:23:11 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 314/946] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:23:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:12 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:23:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:23:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:23:12 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd HTTP/1.1 Apr 14 03:23:12 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:23:12 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:23:12 user devstack@n-api.service[61664]: Connection: close Apr 14 03:23:12 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:23:12 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:23:12 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:23:12 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:23:12 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:23:12 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:23:12 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:23:12 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:23:12 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:23:12 user devstack@n-api.service[61664]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:23:12 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:23:12 user devstack@n-api.service[61664]: method: > Apr 14 03:23:12 user devstack@n-api.service[61664]: exception: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:23:12 user devstack@n-api.service[61664]: action_args: {'id': '9b91538e-2a4b-453b-bfb3-5e569da0a3cd'} Apr 14 03:23:12 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:23:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:23:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:23:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f82b5621-91f3-444a-9451-8e172ea97a1f tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd" status: 404 len: 111 microversion: 2.1 time: 0.027974 Apr 14 03:23:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 317/947] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:23:12 2023] GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:23:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bdf4ba0f-37fb-4c15-9d99-ed757a6022be tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '.version_select at 0x7ff11a068790>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-bdf4ba0f-37fb-4c15-9d99-ed757a6022be tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056266938" status: 202 len: 0 microversion: 2.1 time: 0.043564 Apr 14 03:23:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 317/948] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 03:23:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056266938 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:23:12 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:12 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:23:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:12 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lazy-loading 'services' on Instance uuid 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:23:13 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/os-volume_attachments/c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36" status: 202 len: 0 microversion: 2.1 time: 0.208638 Apr 14 03:23:13 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 315/949] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:23:12 2023] DELETE /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/os-volume_attachments/c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:23:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-eebfbfb9-2a19-463d-9659-7f9dfe1b5a7d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:13 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-eebfbfb9-2a19-463d-9659-7f9dfe1b5a7d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:23:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eebfbfb9-2a19-463d-9659-7f9dfe1b5a7d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eebfbfb9-2a19-463d-9659-7f9dfe1b5a7d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eebfbfb9-2a19-463d-9659-7f9dfe1b5a7d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eebfbfb9-2a19-463d-9659-7f9dfe1b5a7d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eebfbfb9-2a19-463d-9659-7f9dfe1b5a7d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eebfbfb9-2a19-463d-9659-7f9dfe1b5a7d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-eebfbfb9-2a19-463d-9659-7f9dfe1b5a7d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068570 Apr 14 03:23:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 318/950] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:23:13 2023] GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:13 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a8cbce75-4907-4f67-8e47-9287a3350e01 req-4519a634-0977-4808-b128-8826a6e97d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420", "name": "network-vif-plugged", "status": "completed", "tag": "587e1221-a4b5-4e33-8621-2606be640411"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a8cbce75-4907-4f67-8e47-9287a3350e01 req-4519a634-0977-4808-b128-8826a6e97d6c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a8cbce75-4907-4f67-8e47-9287a3350e01 req-4519a634-0977-4808-b128-8826a6e97d6c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a8cbce75-4907-4f67-8e47-9287a3350e01 req-4519a634-0977-4808-b128-8826a6e97d6c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:13 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a8cbce75-4907-4f67-8e47-9287a3350e01 req-4519a634-0977-4808-b128-8826a6e97d6c service nova] Creating event network-vif-plugged:587e1221-a4b5-4e33-8621-2606be640411 for instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 on user Apr 14 03:23:13 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a8cbce75-4907-4f67-8e47-9287a3350e01 req-4519a634-0977-4808-b128-8826a6e97d6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052308 Apr 14 03:23:13 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 318/951] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:23:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:15 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-c7585c57-a5d5-437e-8f89-073732140965 req-d3fdc29d-3bc6-4317-8289-79bd4067ec97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420", "name": "network-vif-plugged", "status": "completed", "tag": "587e1221-a4b5-4e33-8621-2606be640411"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c7585c57-a5d5-437e-8f89-073732140965 req-d3fdc29d-3bc6-4317-8289-79bd4067ec97 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c7585c57-a5d5-437e-8f89-073732140965 req-d3fdc29d-3bc6-4317-8289-79bd4067ec97 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:15 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-c7585c57-a5d5-437e-8f89-073732140965 req-d3fdc29d-3bc6-4317-8289-79bd4067ec97 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-c7585c57-a5d5-437e-8f89-073732140965 req-d3fdc29d-3bc6-4317-8289-79bd4067ec97 service nova] Creating event network-vif-plugged:587e1221-a4b5-4e33-8621-2606be640411 for instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 on user Apr 14 03:23:15 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-c7585c57-a5d5-437e-8f89-073732140965 req-d3fdc29d-3bc6-4317-8289-79bd4067ec97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030492 Apr 14 03:23:15 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 316/952] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:23:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: 8cabfa40-3167-4f13-b6f3-4064d326f837] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=10 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] HTTP exception thrown: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 could not be found. Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Request method failure captured: Apr 14 03:23:35 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 HTTP/1.1 Apr 14 03:23:35 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:23:35 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:23:35 user devstack@n-api.service[61664]: Connection: close Apr 14 03:23:35 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:23:35 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:23:35 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:23:35 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:23:35 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMXR-kr9xncbKooOUYTDDwxQf6qU6zMY9yLTZpzwPQK4qB9Nshrwjk8wTlNW5n1Cs6HzH56l9wS6C0lQTUfYT459LjMwBhWh4a7viw-lRuTulzvveTDpEpmb9Xa7HRG6FX0dG1VUx4IOd2Th1Q9G3-Qb76Jcva2Oq8xgy-1pHf9G3cI Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Project-Id: 0bd451b3f6734fe3ac0a8e8a853bb9eb Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}] Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Tenant: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Tenant-Id: 0bd451b3f6734fe3ac0a8e8a853bb9eb Apr 14 03:23:35 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:23:35 user devstack@n-api.service[61664]: X-User: tempest-TestMinimumBasicScenario-144187586-project-member Apr 14 03:23:35 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:23:35 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:23:35 user devstack@n-api.service[61664]: X-User-Id: 12199a43298942898a2e694ee2c5230e Apr 14 03:23:35 user devstack@n-api.service[61664]: X-User-Name: tempest-TestMinimumBasicScenario-144187586-project-member Apr 14 03:23:35 user devstack@n-api.service[61664]: method: > Apr 14 03:23:35 user devstack@n-api.service[61664]: exception: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 could not be found. Apr 14 03:23:35 user devstack@n-api.service[61664]: action_args: {'id': '8cabfa40-3167-4f13-b6f3-4064d326f837'} Apr 14 03:23:35 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 could not be found. Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 could not be found. Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 could not be found. Apr 14 03:23:35 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:23:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Returning 404 to user: Instance 8cabfa40-3167-4f13-b6f3-4064d326f837 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:23:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b5c2247e-00f0-4ad7-907c-6cbdba67907b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837" status: 404 len: 111 microversion: 2.1 time: 0.037766 Apr 14 03:23:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 319/953] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:23:35 2023] GET /compute/v2.1/servers/8cabfa40-3167-4f13-b6f3-4064d326f837 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:23:35 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:35 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:35 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ff3a1fc1-c602-4375-a55d-a314fb99ceea tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '.version_select at 0x7ff11a06b880>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ff3a1fc1-c602-4375-a55d-a314fb99ceea tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-38758631" status: 202 len: 0 microversion: 2.1 time: 0.033551 Apr 14 03:23:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 319/954] 10.0.0.210 () {62 vars in 1343 bytes} [Fri Apr 14 03:23:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-38758631 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:23:37 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:37 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-77d440aa-71f7-4762-8345-466c0f844dc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'create', calling method: .version_select at 0x7ff11a3e2c20>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-35983132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbABr/vH+9uc5wQJ3ZeT8Ydil5OovYfdLqGJBQSVbmCHz/2Slj13rAwCGE1mbPPo0/CwXQms3UgRTIS6Sa1TpYWM58n3w3eYIRd+WO/4CHQY+ShdxeZ/KOMF7laMdnfUw=="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:37 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-77d440aa-71f7-4762-8345-466c0f844dc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Getting quotas for project 0bd451b3f6734fe3ac0a8e8a853bb9eb. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:23:37 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-77d440aa-71f7-4762-8345-466c0f844dc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Getting quotas for user 12199a43298942898a2e694ee2c5230e and project 0bd451b3f6734fe3ac0a8e8a853bb9eb. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:23:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-77d440aa-71f7-4762-8345-466c0f844dc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.054361 Apr 14 03:23:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 317/955] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:23:37 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1949831724", "imageRef": "eed6e9a9-28a5-4022-b718-e7f64bbf7dfd", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-35983132", "networks": [{"uuid": "3b75178e-4dcf-4cc1-b910-443fadcadac4"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:37 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] validate_networks() for [('3b75178e-4dcf-4cc1-b910-443fadcadac4', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Getting quotas for project 0bd451b3f6734fe3ac0a8e8a853bb9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Getting quotas for user 12199a43298942898a2e694ee2c5230e and project 0bd451b3f6734fe3ac0a8e8a853bb9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:23:38 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eed6e9a9-28a5-4022-b718-e7f64bbf7dfd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:23:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a6b34dab-f85a-412c-a70b-b816bc10f44e tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.522110 Apr 14 03:23:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 320/956] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:23:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:23:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9f807a7f-bb40-4c6f-8208-11ab23c94799 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:38 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-9f807a7f-bb40-4c6f-8208-11ab23c94799 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:23:38 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-9f807a7f-bb40-4c6f-8208-11ab23c94799 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:23:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9f807a7f-bb40-4c6f-8208-11ab23c94799 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 200 len: 1251 microversion: 2.1 time: 0.074684 Apr 14 03:23:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 320/957] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:23:38 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 1251 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:23:40 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-e93e76a0-b5d7-491d-84d9-0663631c03f9 req-adc79328-d867-4a73-b9a5-5eafceee1e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e93e76a0-b5d7-491d-84d9-0663631c03f9 req-adc79328-d867-4a73-b9a5-5eafceee1e72 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e93e76a0-b5d7-491d-84d9-0663631c03f9 req-adc79328-d867-4a73-b9a5-5eafceee1e72 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e93e76a0-b5d7-491d-84d9-0663631c03f9 req-adc79328-d867-4a73-b9a5-5eafceee1e72 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-e93e76a0-b5d7-491d-84d9-0663631c03f9 req-adc79328-d867-4a73-b9a5-5eafceee1e72 service nova] Creating event network-changed:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:23:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-e93e76a0-b5d7-491d-84d9-0663631c03f9 req-adc79328-d867-4a73-b9a5-5eafceee1e72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032307 Apr 14 03:23:40 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 318/958] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:23:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b8245910-d9d4-45ca-8aa4-8c0d5234d42c req-6b66b368-ee9b-453c-b6bd-8c2e9f1f6eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "name": "network-vif-plugged", "status": "completed", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b8245910-d9d4-45ca-8aa4-8c0d5234d42c req-6b66b368-ee9b-453c-b6bd-8c2e9f1f6eb6 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b8245910-d9d4-45ca-8aa4-8c0d5234d42c req-6b66b368-ee9b-453c-b6bd-8c2e9f1f6eb6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b8245910-d9d4-45ca-8aa4-8c0d5234d42c req-6b66b368-ee9b-453c-b6bd-8c2e9f1f6eb6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b8245910-d9d4-45ca-8aa4-8c0d5234d42c req-6b66b368-ee9b-453c-b6bd-8c2e9f1f6eb6 service nova] Creating event network-vif-plugged:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:23:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b8245910-d9d4-45ca-8aa4-8c0d5234d42c req-6b66b368-ee9b-453c-b6bd-8c2e9f1f6eb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037290 Apr 14 03:23:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 321/959] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: bd5b587d-58a9-411b-a755-67adaa6bd6c9] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] HTTP exception thrown: Instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 could not be found. Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Request method failure captured: Apr 14 03:23:44 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9 HTTP/1.1 Apr 14 03:23:44 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:23:44 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:23:44 user devstack@n-api.service[61663]: Connection: close Apr 14 03:23:44 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:23:44 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:23:44 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:23:44 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:23:44 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMLY-YMbgZL_GnErger3TQUrNUvk6Tg13Ck3FfGw2YgySl0eFpU2FoFqJ_C6D4mzxWVrJyAllp_09LWRlF9QNgz3po_4bp45hDdOXsfdu44mxFFVRqac5yIQ1zp1IhvbseJpySeO9Lb8OBAU8ohShItEGLEdX-baXuyHupuHs7HYmHw Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Project-Id: bd2c5b2aafaf4ca7bf62e988ac726658 Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd2c5b2aafaf4ca7bf62e988ac726658"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd2c5b2aafaf4ca7bf62e988ac726658"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd2c5b2aafaf4ca7bf62e988ac726658"}]}] Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Tenant-Id: bd2c5b2aafaf4ca7bf62e988ac726658 Apr 14 03:23:44 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:23:44 user devstack@n-api.service[61663]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member Apr 14 03:23:44 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:23:44 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:23:44 user devstack@n-api.service[61663]: X-User-Id: d666936eb0ee43a2ad9e17a12e6e273d Apr 14 03:23:44 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member Apr 14 03:23:44 user devstack@n-api.service[61663]: method: > Apr 14 03:23:44 user devstack@n-api.service[61663]: exception: Instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 could not be found. Apr 14 03:23:44 user devstack@n-api.service[61663]: action_args: {'id': 'bd5b587d-58a9-411b-a755-67adaa6bd6c9'} Apr 14 03:23:44 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 could not be found. Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 could not be found. Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 could not be found. Apr 14 03:23:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Returning 404 to user: Instance bd5b587d-58a9-411b-a755-67adaa6bd6c9 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:23:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-bd72ddb3-a790-4fb2-a496-159f267c4be1 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9" status: 404 len: 111 microversion: 2.87 time: 0.031102 Apr 14 03:23:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 321/960] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:23:44 2023] GET /compute/v2.1/servers/bd5b587d-58a9-411b-a755-67adaa6bd6c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:23:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a" status: 204 len: 0 microversion: 2.87 time: 0.116860 Apr 14 03:23:44 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 319/961] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:23:44 2023] DELETE /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:23:44 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:23:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-83daf203-e726-42ba-a06a-0b6925352c33 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a" status: 200 len: 1776 microversion: 2.87 time: 0.179484 Apr 14 03:23:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 322/962] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:23:44 2023] GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a => generated 1776 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-b2eb1d45-8eb7-4996-829f-291bede29292 req-23633bc4-9469-409c-9af5-0babb8a8f7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b2eb1d45-8eb7-4996-829f-291bede29292 req-23633bc4-9469-409c-9af5-0babb8a8f7b6 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b2eb1d45-8eb7-4996-829f-291bede29292 req-23633bc4-9469-409c-9af5-0babb8a8f7b6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b2eb1d45-8eb7-4996-829f-291bede29292 req-23633bc4-9469-409c-9af5-0babb8a8f7b6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-b2eb1d45-8eb7-4996-829f-291bede29292 req-23633bc4-9469-409c-9af5-0babb8a8f7b6 service nova] Creating event network-vif-unplugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:23:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-b2eb1d45-8eb7-4996-829f-291bede29292 req-23633bc4-9469-409c-9af5-0babb8a8f7b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036547 Apr 14 03:23:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 322/963] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:23:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-575914a9-8356-48d5-881e-a466867113df req-43f8363e-aa53-4ae6-a9b7-1950f6989e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "name": "network-vif-plugged", "status": "completed", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-575914a9-8356-48d5-881e-a466867113df req-43f8363e-aa53-4ae6-a9b7-1950f6989e9c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-575914a9-8356-48d5-881e-a466867113df req-43f8363e-aa53-4ae6-a9b7-1950f6989e9c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-575914a9-8356-48d5-881e-a466867113df req-43f8363e-aa53-4ae6-a9b7-1950f6989e9c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-575914a9-8356-48d5-881e-a466867113df req-43f8363e-aa53-4ae6-a9b7-1950f6989e9c service nova] Creating event network-vif-plugged:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:23:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-575914a9-8356-48d5-881e-a466867113df req-43f8363e-aa53-4ae6-a9b7-1950f6989e9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038402 Apr 14 03:23:44 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 320/964] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:23:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-6803cb4f-4a31-40b7-8932-27cb13f54ce0 req-0431431e-7ef2-4782-a4c2-a9e7e7ad522e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6803cb4f-4a31-40b7-8932-27cb13f54ce0 req-0431431e-7ef2-4782-a4c2-a9e7e7ad522e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6803cb4f-4a31-40b7-8932-27cb13f54ce0 req-0431431e-7ef2-4782-a4c2-a9e7e7ad522e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6803cb4f-4a31-40b7-8932-27cb13f54ce0 req-0431431e-7ef2-4782-a4c2-a9e7e7ad522e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6803cb4f-4a31-40b7-8932-27cb13f54ce0 req-0431431e-7ef2-4782-a4c2-a9e7e7ad522e service nova] Creating event network-vif-plugged:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:23:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-6803cb4f-4a31-40b7-8932-27cb13f54ce0 req-0431431e-7ef2-4782-a4c2-a9e7e7ad522e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033387 Apr 14 03:23:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 323/965] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:23:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-af5130cb-72f9-4a8b-95c8-149c0556e3e2 req-9427057b-07dd-4df2-b628-c26a2a549f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2692a422-82e6-4f3b-b91e-6a2ea28e4d0a", "name": "network-vif-deleted", "tag": "3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:23:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-af5130cb-72f9-4a8b-95c8-149c0556e3e2 req-9427057b-07dd-4df2-b628-c26a2a549f12 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-af5130cb-72f9-4a8b-95c8-149c0556e3e2 req-9427057b-07dd-4df2-b628-c26a2a549f12 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-af5130cb-72f9-4a8b-95c8-149c0556e3e2 req-9427057b-07dd-4df2-b628-c26a2a549f12 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-af5130cb-72f9-4a8b-95c8-149c0556e3e2 req-9427057b-07dd-4df2-b628-c26a2a549f12 service nova] Creating event network-vif-deleted:3b7ac3bb-62fa-4afb-8ede-abd8fa94c0b5 for instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a on user Apr 14 03:23:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-af5130cb-72f9-4a8b-95c8-149c0556e3e2 req-9427057b-07dd-4df2-b628-c26a2a549f12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035643 Apr 14 03:23:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 323/966] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:23:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a3955c26-4bd6-4d97-b1f7-8af2adfdea1c tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-a3955c26-4bd6-4d97-b1f7-8af2adfdea1c tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] [instance: 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a3955c26-4bd6-4d97-b1f7-8af2adfdea1c tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a3955c26-4bd6-4d97-b1f7-8af2adfdea1c tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a3955c26-4bd6-4d97-b1f7-8af2adfdea1c tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a3955c26-4bd6-4d97-b1f7-8af2adfdea1c tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a3955c26-4bd6-4d97-b1f7-8af2adfdea1c tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a3955c26-4bd6-4d97-b1f7-8af2adfdea1c tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:23:58 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-a3955c26-4bd6-4d97-b1f7-8af2adfdea1c tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a2f927a9b94b6a8e9d91932bab0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccb5ceb9f7641a9b6265de1f3c38c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:23:58 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a3955c26-4bd6-4d97-b1f7-8af2adfdea1c tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420" status: 200 len: 1455 microversion: 2.1 time: 0.220156 Apr 14 03:23:58 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 321/967] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:23:58 2023] GET /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 => generated 1455 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=14 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-36c1b9e8-b323-4d74-a5e5-5be01a9e5444 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-36c1b9e8-b323-4d74-a5e5-5be01a9e5444 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-36c1b9e8-b323-4d74-a5e5-5be01a9e5444 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-36c1b9e8-b323-4d74-a5e5-5be01a9e5444 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-36c1b9e8-b323-4d74-a5e5-5be01a9e5444 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-36c1b9e8-b323-4d74-a5e5-5be01a9e5444 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-36c1b9e8-b323-4d74-a5e5-5be01a9e5444 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-36c1b9e8-b323-4d74-a5e5-5be01a9e5444 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-36c1b9e8-b323-4d74-a5e5-5be01a9e5444 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.205313 Apr 14 03:24:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 324/968] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:24:03 2023] GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7/os-volume_attachments => generated 25 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9468725b-346d-479f-a82d-8e056782870e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-9468725b-346d-479f-a82d-8e056782870e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9468725b-346d-479f-a82d-8e056782870e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9468725b-346d-479f-a82d-8e056782870e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9468725b-346d-479f-a82d-8e056782870e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9468725b-346d-479f-a82d-8e056782870e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9468725b-346d-479f-a82d-8e056782870e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9468725b-346d-479f-a82d-8e056782870e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-9468725b-346d-479f-a82d-8e056782870e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:24:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9468725b-346d-479f-a82d-8e056782870e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7" status: 204 len: 0 microversion: 2.1 time: 0.134991 Apr 14 03:24:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 324/969] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:24:03 2023] DELETE /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:24:03 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-a922a2cd-a79d-4f83-b24c-201f637d8f6b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:03 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-a922a2cd-a79d-4f83-b24c-201f637d8f6b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a922a2cd-a79d-4f83-b24c-201f637d8f6b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a922a2cd-a79d-4f83-b24c-201f637d8f6b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a922a2cd-a79d-4f83-b24c-201f637d8f6b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a922a2cd-a79d-4f83-b24c-201f637d8f6b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a922a2cd-a79d-4f83-b24c-201f637d8f6b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-a922a2cd-a79d-4f83-b24c-201f637d8f6b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:03 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-a922a2cd-a79d-4f83-b24c-201f637d8f6b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:24:03 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-a922a2cd-a79d-4f83-b24c-201f637d8f6b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7" status: 200 len: 1668 microversion: 2.1 time: 0.195040 Apr 14 03:24:03 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 322/970] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:24:03 2023] GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 => generated 1668 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f437f814-3ca6-4e4f-aa02-b0f83fc49e73 req-8d136185-b733-4ca5-96e2-1b5be117b12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04737acf-2aa7-4f8c-a33d-fa2b50ea29d7", "name": "network-vif-unplugged", "status": "completed", "tag": "4ceedbf8-a65d-4a77-b13c-837ae6290ea1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f437f814-3ca6-4e4f-aa02-b0f83fc49e73 req-8d136185-b733-4ca5-96e2-1b5be117b12f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f437f814-3ca6-4e4f-aa02-b0f83fc49e73 req-8d136185-b733-4ca5-96e2-1b5be117b12f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f437f814-3ca6-4e4f-aa02-b0f83fc49e73 req-8d136185-b733-4ca5-96e2-1b5be117b12f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f437f814-3ca6-4e4f-aa02-b0f83fc49e73 req-8d136185-b733-4ca5-96e2-1b5be117b12f service nova] Creating event network-vif-unplugged:4ceedbf8-a65d-4a77-b13c-837ae6290ea1 for instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 on user Apr 14 03:24:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f437f814-3ca6-4e4f-aa02-b0f83fc49e73 req-8d136185-b733-4ca5-96e2-1b5be117b12f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067736 Apr 14 03:24:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 325/971] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:24:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:24:05 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-797aaaff-eddf-4d86-b38a-2bbb1dcc5fe4 req-8dac16e0-afc7-40a7-99b8-711070fb2dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04737acf-2aa7-4f8c-a33d-fa2b50ea29d7", "name": "network-vif-plugged", "status": "completed", "tag": "4ceedbf8-a65d-4a77-b13c-837ae6290ea1"}, {"server_uuid": "04737acf-2aa7-4f8c-a33d-fa2b50ea29d7", "name": "network-vif-deleted", "tag": "4ceedbf8-a65d-4a77-b13c-837ae6290ea1"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:24:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-797aaaff-eddf-4d86-b38a-2bbb1dcc5fe4 req-8dac16e0-afc7-40a7-99b8-711070fb2dc4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-797aaaff-eddf-4d86-b38a-2bbb1dcc5fe4 req-8dac16e0-afc7-40a7-99b8-711070fb2dc4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-797aaaff-eddf-4d86-b38a-2bbb1dcc5fe4 req-8dac16e0-afc7-40a7-99b8-711070fb2dc4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-797aaaff-eddf-4d86-b38a-2bbb1dcc5fe4 req-8dac16e0-afc7-40a7-99b8-711070fb2dc4 service nova] Creating event network-vif-plugged:4ceedbf8-a65d-4a77-b13c-837ae6290ea1 for instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 on user Apr 14 03:24:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-797aaaff-eddf-4d86-b38a-2bbb1dcc5fe4 req-8dac16e0-afc7-40a7-99b8-711070fb2dc4 service nova] Creating event network-vif-deleted:4ceedbf8-a65d-4a77-b13c-837ae6290ea1 for instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 on user Apr 14 03:24:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-797aaaff-eddf-4d86-b38a-2bbb1dcc5fe4 req-8dac16e0-afc7-40a7-99b8-711070fb2dc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033821 Apr 14 03:24:05 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 325/972] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:24:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-2cbf19f6-cab2-46f0-8100-439eb72e12b9 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-2cbf19f6-cab2-46f0-8100-439eb72e12b9 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=12 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2cbf19f6-cab2-46f0-8100-439eb72e12b9 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2cbf19f6-cab2-46f0-8100-439eb72e12b9 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2cbf19f6-cab2-46f0-8100-439eb72e12b9 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2cbf19f6-cab2-46f0-8100-439eb72e12b9 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2cbf19f6-cab2-46f0-8100-439eb72e12b9 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-2cbf19f6-cab2-46f0-8100-439eb72e12b9 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:28 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-2cbf19f6-cab2-46f0-8100-439eb72e12b9 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:24:28 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-2cbf19f6-cab2-46f0-8100-439eb72e12b9 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 200 len: 1535 microversion: 2.1 time: 0.174407 Apr 14 03:24:28 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 323/973] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:24:28 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 1535 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] HTTP exception thrown: Instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a could not be found. Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Request method failure captured: Apr 14 03:24:34 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a HTTP/1.1 Apr 14 03:24:34 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:24:34 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:24:34 user devstack@n-api.service[61664]: Connection: close Apr 14 03:24:34 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:24:34 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:24:34 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:24:34 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:24:34 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMLY-YMbgZL_GnErger3TQUrNUvk6Tg13Ck3FfGw2YgySl0eFpU2FoFqJ_C6D4mzxWVrJyAllp_09LWRlF9QNgz3po_4bp45hDdOXsfdu44mxFFVRqac5yIQ1zp1IhvbseJpySeO9Lb8OBAU8ohShItEGLEdX-baXuyHupuHs7HYmHw Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Project-Id: bd2c5b2aafaf4ca7bf62e988ac726658 Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd2c5b2aafaf4ca7bf62e988ac726658"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd2c5b2aafaf4ca7bf62e988ac726658"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd2c5b2aafaf4ca7bf62e988ac726658"}]}] Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Tenant-Id: bd2c5b2aafaf4ca7bf62e988ac726658 Apr 14 03:24:34 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:24:34 user devstack@n-api.service[61664]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member Apr 14 03:24:34 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:24:34 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:24:34 user devstack@n-api.service[61664]: X-User-Id: d666936eb0ee43a2ad9e17a12e6e273d Apr 14 03:24:34 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member Apr 14 03:24:34 user devstack@n-api.service[61664]: method: > Apr 14 03:24:34 user devstack@n-api.service[61664]: exception: Instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a could not be found. Apr 14 03:24:34 user devstack@n-api.service[61664]: action_args: {'id': '2692a422-82e6-4f3b-b91e-6a2ea28e4d0a'} Apr 14 03:24:34 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a could not be found. Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a could not be found. Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a could not be found. Apr 14 03:24:34 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:24:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Returning 404 to user: Instance 2692a422-82e6-4f3b-b91e-6a2ea28e4d0a could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:24:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6ef4e689-a848-4d71-9bc8-dbf95982cd46 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a" status: 404 len: 111 microversion: 2.87 time: 0.067811 Apr 14 03:24:34 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 326/974] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:24:34 2023] GET /compute/v2.1/servers/2692a422-82e6-4f3b-b91e-6a2ea28e4d0a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c2432d85-e5ae-4b2a-8758-c29bc3d9aeb7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c2432d85-e5ae-4b2a-8758-c29bc3d9aeb7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c2432d85-e5ae-4b2a-8758-c29bc3d9aeb7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c2432d85-e5ae-4b2a-8758-c29bc3d9aeb7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c2432d85-e5ae-4b2a-8758-c29bc3d9aeb7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c2432d85-e5ae-4b2a-8758-c29bc3d9aeb7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c2432d85-e5ae-4b2a-8758-c29bc3d9aeb7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c2432d85-e5ae-4b2a-8758-c29bc3d9aeb7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:34 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c2432d85-e5ae-4b2a-8758-c29bc3d9aeb7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:24:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c2432d85-e5ae-4b2a-8758-c29bc3d9aeb7 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e" status: 204 len: 0 microversion: 2.87 time: 0.156307 Apr 14 03:24:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 326/975] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:24:34 2023] DELETE /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:24:34 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:34 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:35 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:24:35 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:24:35 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd666936eb0ee43a2ad9e17a12e6e273d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2c5b2aafaf4ca7bf62e988ac726658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:24:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-0358b05a-d4c7-40f2-ac8b-872852fe92d6 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e" status: 200 len: 1696 microversion: 2.87 time: 0.208188 Apr 14 03:24:35 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 324/976] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:24:34 2023] GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e => generated 1696 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:24:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-3b78b11f-6d1c-4c53-a8d6-def17b35327c req-a1ee9f87-f171-43c0-b3ba-a890c7cbd304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e", "name": "network-vif-unplugged", "status": "completed", "tag": "22f727c9-9207-46e6-a471-48de5bf03677"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:24:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3b78b11f-6d1c-4c53-a8d6-def17b35327c req-a1ee9f87-f171-43c0-b3ba-a890c7cbd304 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3b78b11f-6d1c-4c53-a8d6-def17b35327c req-a1ee9f87-f171-43c0-b3ba-a890c7cbd304 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3b78b11f-6d1c-4c53-a8d6-def17b35327c req-a1ee9f87-f171-43c0-b3ba-a890c7cbd304 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-3b78b11f-6d1c-4c53-a8d6-def17b35327c req-a1ee9f87-f171-43c0-b3ba-a890c7cbd304 service nova] Creating event network-vif-unplugged:22f727c9-9207-46e6-a471-48de5bf03677 for instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e on user Apr 14 03:24:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-3b78b11f-6d1c-4c53-a8d6-def17b35327c req-a1ee9f87-f171-43c0-b3ba-a890c7cbd304 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034178 Apr 14 03:24:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 327/977] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:24:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:24:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-0b35f89c-198c-46c4-acf6-2f0abd55e5f0 req-8201de75-86d7-4a45-9328-a968f304f491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e", "name": "network-vif-deleted", "tag": "22f727c9-9207-46e6-a471-48de5bf03677"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:24:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0b35f89c-198c-46c4-acf6-2f0abd55e5f0 req-8201de75-86d7-4a45-9328-a968f304f491 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0b35f89c-198c-46c4-acf6-2f0abd55e5f0 req-8201de75-86d7-4a45-9328-a968f304f491 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0b35f89c-198c-46c4-acf6-2f0abd55e5f0 req-8201de75-86d7-4a45-9328-a968f304f491 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-0b35f89c-198c-46c4-acf6-2f0abd55e5f0 req-8201de75-86d7-4a45-9328-a968f304f491 service nova] Creating event network-vif-deleted:22f727c9-9207-46e6-a471-48de5bf03677 for instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e on user Apr 14 03:24:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-0b35f89c-198c-46c4-acf6-2f0abd55e5f0 req-8201de75-86d7-4a45-9328-a968f304f491 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031722 Apr 14 03:24:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 327/978] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:24:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:24:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-d0583e36-91fd-4714-9d31-1207eaafb205 req-9cfe7024-aa98-4811-92a2-91c89fdb7f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e", "name": "network-vif-plugged", "status": "completed", "tag": "22f727c9-9207-46e6-a471-48de5bf03677"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:24:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d0583e36-91fd-4714-9d31-1207eaafb205 req-9cfe7024-aa98-4811-92a2-91c89fdb7f7a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d0583e36-91fd-4714-9d31-1207eaafb205 req-9cfe7024-aa98-4811-92a2-91c89fdb7f7a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-d0583e36-91fd-4714-9d31-1207eaafb205 req-9cfe7024-aa98-4811-92a2-91c89fdb7f7a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-d0583e36-91fd-4714-9d31-1207eaafb205 req-9cfe7024-aa98-4811-92a2-91c89fdb7f7a service nova] Creating event network-vif-plugged:22f727c9-9207-46e6-a471-48de5bf03677 for instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e on user Apr 14 03:24:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-d0583e36-91fd-4714-9d31-1207eaafb205 req-9cfe7024-aa98-4811-92a2-91c89fdb7f7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029974 Apr 14 03:24:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 325/979] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:24:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:24:53 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 HTTP/1.1 Apr 14 03:24:53 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:24:53 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:24:53 user devstack@n-api.service[61664]: Connection: close Apr 14 03:24:53 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:24:53 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:24:53 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:24:53 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:24:53 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:24:53 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:24:53 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:24:53 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:24:53 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:24:53 user devstack@n-api.service[61664]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:24:53 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:24:53 user devstack@n-api.service[61664]: method: > Apr 14 03:24:53 user devstack@n-api.service[61664]: exception: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:24:53 user devstack@n-api.service[61664]: action_args: {'id': '04737acf-2aa7-4f8c-a33d-fa2b50ea29d7'} Apr 14 03:24:53 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:24:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:24:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:24:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-084634fb-a5b5-43ea-a5be-a4ae69e63cb7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7" status: 404 len: 111 microversion: 2.1 time: 0.036871 Apr 14 03:24:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 328/980] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:24:53 2023] GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:24:53 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:53 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5231c6ff-5e15-4f70-a70a-2e20d5d67398 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '.version_select at 0x7ff11a06a9e0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5231c6ff-5e15-4f70-a70a-2e20d5d67398 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704381483" status: 202 len: 0 microversion: 2.1 time: 0.031377 Apr 14 03:24:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 328/981] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 03:24:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704381483 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:24:54 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=8 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:54 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=14 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:54 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b344ed49-1962-451a-8cba-ffe191d96d36 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: .version_select at 0x7ff11a19f130>, body: {"keypair": {"name": "tempest-keypair-78190679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSndsO1c3Z/qbd8lMMRUmZaXIsLfHJCvVNKXkbSK6BNAUu8fZlUrW/Bo5eB9unTY8Vd9653h8+Lb0zpI92t1zd8+Jm7Lui4VceF8r90LX85pQ7OZIoo8WWYkwS7ywbzgQ=="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:24:54 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-b344ed49-1962-451a-8cba-ffe191d96d36 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for project 3b689b65111045168cf21c51bf1274f2. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:24:54 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-b344ed49-1962-451a-8cba-ffe191d96d36 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for user c1390cde350341c3ac0275e429146cf8 and project 3b689b65111045168cf21c51bf1274f2. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:24:54 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b344ed49-1962-451a-8cba-ffe191d96d36 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.048788 Apr 14 03:24:54 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 326/982] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:24:54 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2077804000", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c6419e57-87af-44c1-a594-3a6a40f976b8"}], "security_groups": [{"name": "tempest-securitygroup--1626129972"}], "key_name": "tempest-keypair-78190679", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] validate_networks() for [('c6419e57-87af-44c1-a594-3a6a40f976b8', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for project 3b689b65111045168cf21c51bf1274f2. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for user c1390cde350341c3ac0275e429146cf8 and project 3b689b65111045168cf21c51bf1274f2. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:24:56 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:24:56 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-fcec5671-4e82-4837-bf41-df190aaa6068 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.869057 Apr 14 03:24:56 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 329/983] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:24:56 2023] POST /compute/v2.1/servers => generated 400 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:24:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-56698604-0279-4b33-bded-fea0746594be tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:56 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-56698604-0279-4b33-bded-fea0746594be tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:56 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-56698604-0279-4b33-bded-fea0746594be tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:24:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-56698604-0279-4b33-bded-fea0746594be tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4" status: 200 len: 1234 microversion: 2.1 time: 0.062022 Apr 14 03:24:56 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 329/984] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:24:56 2023] GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4 => generated 1234 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:24:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-cf7715b3-2a5a-4ce9-8b72-d630c0b8f86d tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:58 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-cf7715b3-2a5a-4ce9-8b72-d630c0b8f86d tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] [instance: 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf7715b3-2a5a-4ce9-8b72-d630c0b8f86d tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf7715b3-2a5a-4ce9-8b72-d630c0b8f86d tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf7715b3-2a5a-4ce9-8b72-d630c0b8f86d tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf7715b3-2a5a-4ce9-8b72-d630c0b8f86d tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf7715b3-2a5a-4ce9-8b72-d630c0b8f86d tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-cf7715b3-2a5a-4ce9-8b72-d630c0b8f86d tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:58 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-cf7715b3-2a5a-4ce9-8b72-d630c0b8f86d tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] [instance: 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:24:58 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-cf7715b3-2a5a-4ce9-8b72-d630c0b8f86d tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420" status: 204 len: 0 microversion: 2.1 time: 0.133720 Apr 14 03:24:58 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 327/985] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:24:58 2023] DELETE /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:24:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b1f1828c-4f14-4b06-ab6e-84c1e1b644ee tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:24:58 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b1f1828c-4f14-4b06-ab6e-84c1e1b644ee tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] [instance: 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:24:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1f1828c-4f14-4b06-ab6e-84c1e1b644ee tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1f1828c-4f14-4b06-ab6e-84c1e1b644ee tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1f1828c-4f14-4b06-ab6e-84c1e1b644ee tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1f1828c-4f14-4b06-ab6e-84c1e1b644ee tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1f1828c-4f14-4b06-ab6e-84c1e1b644ee tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1f1828c-4f14-4b06-ab6e-84c1e1b644ee tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:59 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b1f1828c-4f14-4b06-ab6e-84c1e1b644ee tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a2f927a9b94b6a8e9d91932bab0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccb5ceb9f7641a9b6265de1f3c38c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:24:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b1f1828c-4f14-4b06-ab6e-84c1e1b644ee tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420" status: 200 len: 1461 microversion: 2.1 time: 0.247095 Apr 14 03:24:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 330/986] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:24:58 2023] GET /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 => generated 1461 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:24:59 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-948ada83-640e-4a2c-afde-d538812e08d4 req-dd094c60-e047-48aa-8cee-8a726492b602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82dc7444-2886-4be4-b565-99e1cb0a70e4", "tag": "08a928bc-74c8-42cf-92a5-f3470037e540"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:24:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-948ada83-640e-4a2c-afde-d538812e08d4 req-dd094c60-e047-48aa-8cee-8a726492b602 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:24:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-948ada83-640e-4a2c-afde-d538812e08d4 req-dd094c60-e047-48aa-8cee-8a726492b602 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:24:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-948ada83-640e-4a2c-afde-d538812e08d4 req-dd094c60-e047-48aa-8cee-8a726492b602 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:24:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-948ada83-640e-4a2c-afde-d538812e08d4 req-dd094c60-e047-48aa-8cee-8a726492b602 service nova] Creating event network-changed:08a928bc-74c8-42cf-92a5-f3470037e540 for instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 on user Apr 14 03:24:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-948ada83-640e-4a2c-afde-d538812e08d4 req-dd094c60-e047-48aa-8cee-8a726492b602 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144377 Apr 14 03:24:59 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 330/987] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:24:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:00 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-1a3df7ed-b031-45e7-9028-638ad19ab672 req-83b9765d-bca1-44c1-b1e4-57bcdc9ae2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420", "name": "network-vif-deleted", "tag": "587e1221-a4b5-4e33-8621-2606be640411"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1a3df7ed-b031-45e7-9028-638ad19ab672 req-83b9765d-bca1-44c1-b1e4-57bcdc9ae2d9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1a3df7ed-b031-45e7-9028-638ad19ab672 req-83b9765d-bca1-44c1-b1e4-57bcdc9ae2d9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:00 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-1a3df7ed-b031-45e7-9028-638ad19ab672 req-83b9765d-bca1-44c1-b1e4-57bcdc9ae2d9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:00 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-1a3df7ed-b031-45e7-9028-638ad19ab672 req-83b9765d-bca1-44c1-b1e4-57bcdc9ae2d9 service nova] Creating event network-vif-deleted:587e1221-a4b5-4e33-8621-2606be640411 for instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 on user Apr 14 03:25:00 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-1a3df7ed-b031-45e7-9028-638ad19ab672 req-83b9765d-bca1-44c1-b1e4-57bcdc9ae2d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027577 Apr 14 03:25:00 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 328/988] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b9bba94c-53e8-4a54-b320-c0e4e88bc009 req-c4477045-bd37-4cd9-aa43-2d6f573e1108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420", "name": "network-vif-unplugged", "status": "completed", "tag": "587e1221-a4b5-4e33-8621-2606be640411"}, {"server_uuid": "864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420", "name": "network-vif-plugged", "status": "completed", "tag": "587e1221-a4b5-4e33-8621-2606be640411"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b9bba94c-53e8-4a54-b320-c0e4e88bc009 req-c4477045-bd37-4cd9-aa43-2d6f573e1108 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b9bba94c-53e8-4a54-b320-c0e4e88bc009 req-c4477045-bd37-4cd9-aa43-2d6f573e1108 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b9bba94c-53e8-4a54-b320-c0e4e88bc009 req-c4477045-bd37-4cd9-aa43-2d6f573e1108 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b9bba94c-53e8-4a54-b320-c0e4e88bc009 req-c4477045-bd37-4cd9-aa43-2d6f573e1108 service nova] Creating event network-vif-unplugged:587e1221-a4b5-4e33-8621-2606be640411 for instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 on user Apr 14 03:25:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b9bba94c-53e8-4a54-b320-c0e4e88bc009 req-c4477045-bd37-4cd9-aa43-2d6f573e1108 service nova] Creating event network-vif-plugged:587e1221-a4b5-4e33-8621-2606be640411 for instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 on user Apr 14 03:25:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b9bba94c-53e8-4a54-b320-c0e4e88bc009 req-c4477045-bd37-4cd9-aa43-2d6f573e1108 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.048026 Apr 14 03:25:01 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 331/989] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:01 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d0548eb3-1d5a-4926-b213-cb30d2b98946 req-2e706860-e347-456b-b2ba-fdcdaa19f085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dc7444-2886-4be4-b565-99e1cb0a70e4", "name": "network-vif-plugged", "status": "completed", "tag": "08a928bc-74c8-42cf-92a5-f3470037e540"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d0548eb3-1d5a-4926-b213-cb30d2b98946 req-2e706860-e347-456b-b2ba-fdcdaa19f085 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d0548eb3-1d5a-4926-b213-cb30d2b98946 req-2e706860-e347-456b-b2ba-fdcdaa19f085 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d0548eb3-1d5a-4926-b213-cb30d2b98946 req-2e706860-e347-456b-b2ba-fdcdaa19f085 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d0548eb3-1d5a-4926-b213-cb30d2b98946 req-2e706860-e347-456b-b2ba-fdcdaa19f085 service nova] Creating event network-vif-plugged:08a928bc-74c8-42cf-92a5-f3470037e540 for instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 on user Apr 14 03:25:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d0548eb3-1d5a-4926-b213-cb30d2b98946 req-2e706860-e347-456b-b2ba-fdcdaa19f085 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089978 Apr 14 03:25:01 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 331/990] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:03 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-99bc3e83-442b-4e2d-ac15-8445c2ca1d7c req-2199cc62-ae3a-4930-bad8-f7b1f21461d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dc7444-2886-4be4-b565-99e1cb0a70e4", "name": "network-vif-plugged", "status": "completed", "tag": "08a928bc-74c8-42cf-92a5-f3470037e540"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-99bc3e83-442b-4e2d-ac15-8445c2ca1d7c req-2199cc62-ae3a-4930-bad8-f7b1f21461d8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-99bc3e83-442b-4e2d-ac15-8445c2ca1d7c req-2199cc62-ae3a-4930-bad8-f7b1f21461d8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-99bc3e83-442b-4e2d-ac15-8445c2ca1d7c req-2199cc62-ae3a-4930-bad8-f7b1f21461d8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:03 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-99bc3e83-442b-4e2d-ac15-8445c2ca1d7c req-2199cc62-ae3a-4930-bad8-f7b1f21461d8 service nova] Creating event network-vif-plugged:08a928bc-74c8-42cf-92a5-f3470037e540 for instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 on user Apr 14 03:25:03 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-99bc3e83-442b-4e2d-ac15-8445c2ca1d7c req-2199cc62-ae3a-4930-bad8-f7b1f21461d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030611 Apr 14 03:25:03 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 329/991] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=12 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] [instance: d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] HTTP exception thrown: Instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e could not be found. Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Request method failure captured: Apr 14 03:25:25 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e HTTP/1.1 Apr 14 03:25:25 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:25:25 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:25:25 user devstack@n-api.service[61664]: Connection: close Apr 14 03:25:25 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:25:25 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:25:25 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:25:25 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:25:25 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMLY-YMbgZL_GnErger3TQUrNUvk6Tg13Ck3FfGw2YgySl0eFpU2FoFqJ_C6D4mzxWVrJyAllp_09LWRlF9QNgz3po_4bp45hDdOXsfdu44mxFFVRqac5yIQ1zp1IhvbseJpySeO9Lb8OBAU8ohShItEGLEdX-baXuyHupuHs7HYmHw Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Project-Id: bd2c5b2aafaf4ca7bf62e988ac726658 Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd2c5b2aafaf4ca7bf62e988ac726658"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd2c5b2aafaf4ca7bf62e988ac726658"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd2c5b2aafaf4ca7bf62e988ac726658"}]}] Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Tenant-Id: bd2c5b2aafaf4ca7bf62e988ac726658 Apr 14 03:25:25 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371 Apr 14 03:25:25 user devstack@n-api.service[61664]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member Apr 14 03:25:25 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:25:25 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:25:25 user devstack@n-api.service[61664]: X-User-Id: d666936eb0ee43a2ad9e17a12e6e273d Apr 14 03:25:25 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member Apr 14 03:25:25 user devstack@n-api.service[61664]: method: > Apr 14 03:25:25 user devstack@n-api.service[61664]: exception: Instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e could not be found. Apr 14 03:25:25 user devstack@n-api.service[61664]: action_args: {'id': 'd7277eb6-c2d1-4c3a-8986-51d3fbf1c29e'} Apr 14 03:25:25 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e could not be found. Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e could not be found. Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e could not be found. Apr 14 03:25:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:25:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] Returning 404 to user: Instance d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:25:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b8567589-5d07-4ec1-bcaf-5f0e6e676f51 tempest-ServerBootFromVolumeStableRescueTest-1400694371 tempest-ServerBootFromVolumeStableRescueTest-1400694371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e" status: 404 len: 111 microversion: 2.87 time: 0.040778 Apr 14 03:25:25 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 332/992] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:25:25 2023] GET /compute/v2.1/servers/d7277eb6-c2d1-4c3a-8986-51d3fbf1c29e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b51dd98f-10e7-4ff4-9366-b817d38a483a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b51dd98f-10e7-4ff4-9366-b817d38a483a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b51dd98f-10e7-4ff4-9366-b817d38a483a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b51dd98f-10e7-4ff4-9366-b817d38a483a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b51dd98f-10e7-4ff4-9366-b817d38a483a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b51dd98f-10e7-4ff4-9366-b817d38a483a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b51dd98f-10e7-4ff4-9366-b817d38a483a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b51dd98f-10e7-4ff4-9366-b817d38a483a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:28 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-b51dd98f-10e7-4ff4-9366-b817d38a483a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:25:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b51dd98f-10e7-4ff4-9366-b817d38a483a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 200 len: 1535 microversion: 2.1 time: 0.188030 Apr 14 03:25:28 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 332/993] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:25:28 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 1535 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Searching by: {'deleted': False, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb'} {{(pid=61662) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:28 user devstack@n-api.service[61662]: DEBUG nova.compute.multi_cell_list [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61662) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 03:25:28 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-05d3222f-2aed-4c8a-80ba-70e2fc854fd2 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.079237 Apr 14 03:25:28 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 330/994] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 03:25:28 2023] GET /compute/v2.1/servers => generated 341 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:28 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-25d0e16a-5beb-4d45-848e-43b967615da4 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:25:28 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-25d0e16a-5beb-4d45-848e-43b967615da4 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25d0e16a-5beb-4d45-848e-43b967615da4 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25d0e16a-5beb-4d45-848e-43b967615da4 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25d0e16a-5beb-4d45-848e-43b967615da4 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25d0e16a-5beb-4d45-848e-43b967615da4 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25d0e16a-5beb-4d45-848e-43b967615da4 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-25d0e16a-5beb-4d45-848e-43b967615da4 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:29 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-25d0e16a-5beb-4d45-848e-43b967615da4 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:25:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-25d0e16a-5beb-4d45-848e-43b967615da4 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 200 len: 1535 microversion: 2.1 time: 0.227425 Apr 14 03:25:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 333/995] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:25:28 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 1535 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:25:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-038a3209-0938-49e7-b4cd-ec37655b430a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:31 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-038a3209-0938-49e7-b4cd-ec37655b430a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-038a3209-0938-49e7-b4cd-ec37655b430a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-038a3209-0938-49e7-b4cd-ec37655b430a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-038a3209-0938-49e7-b4cd-ec37655b430a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-038a3209-0938-49e7-b4cd-ec37655b430a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-038a3209-0938-49e7-b4cd-ec37655b430a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-038a3209-0938-49e7-b4cd-ec37655b430a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-038a3209-0938-49e7-b4cd-ec37655b430a tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255336 Apr 14 03:25:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 333/996] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:25:31 2023] POST /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-9e0f3d18-36fe-49d6-b3e4-06d02366cfb1 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Action: 'create', calling method: .version_select at 0x7ff11a3e04c0>, body: {"keypair": {"name": "tempest-keypair-1931660222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJClBvq+izruhg+hEGBNF3dbytQyMHTMScVlN0JyjMZhWJs7Q0qW6oRUDMkWmHhWGirQ5OTk6+cGFOrE1Qs+cgpleFl1Ec3q//B2mJ5NTiLySOLz8iea1keakGG6m35P8g=="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:37 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-9e0f3d18-36fe-49d6-b3e4-06d02366cfb1 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Getting quotas for project 7ed26668c2cb49c38d16ff728d38bef2. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:25:37 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-9e0f3d18-36fe-49d6-b3e4-06d02366cfb1 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Getting quotas for user f88237b825b24effad17900bbf645ab8 and project 7ed26668c2cb49c38d16ff728d38bef2. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:25:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-9e0f3d18-36fe-49d6-b3e4-06d02366cfb1 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.152938 Apr 14 03:25:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 331/997] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 03:25:37 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-240447376", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "37d06f06-d5c9-414b-bbc2-17c9a433bc16"}], "security_groups": [{"name": "tempest-securitygroup--2078094760"}], "key_name": "tempest-keypair-1931660222", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] validate_networks() for [('37d06f06-d5c9-414b-bbc2-17c9a433bc16', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:25:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8bd5912b-ce73-499a-b82b-3a69c3c92968 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:25:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-8bd5912b-ce73-499a-b82b-3a69c3c92968 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8bd5912b-ce73-499a-b82b-3a69c3c92968 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8bd5912b-ce73-499a-b82b-3a69c3c92968 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8bd5912b-ce73-499a-b82b-3a69c3c92968 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8bd5912b-ce73-499a-b82b-3a69c3c92968 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8bd5912b-ce73-499a-b82b-3a69c3c92968 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8bd5912b-ce73-499a-b82b-3a69c3c92968 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-8bd5912b-ce73-499a-b82b-3a69c3c92968 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:25:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8bd5912b-ce73-499a-b82b-3a69c3c92968 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 200 len: 1581 microversion: 2.1 time: 0.145425 Apr 14 03:25:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 334/998] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:25:39 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 1581 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Getting quotas for project 7ed26668c2cb49c38d16ff728d38bef2. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Getting quotas for user f88237b825b24effad17900bbf645ab8 and project 7ed26668c2cb49c38d16ff728d38bef2. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:25:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:25:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a521d73c-35f0-4629-8e76-62843dc2ec14 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.530237 Apr 14 03:25:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 334/999] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 03:25:39 2023] POST /compute/v2.1/servers => generated 400 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 03:25:39 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:39 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=8 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:39 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d53b5efe-5b3b-4069-88d8-b617f35f13c1 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:25:39 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d53b5efe-5b3b-4069-88d8-b617f35f13c1 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:39 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-d53b5efe-5b3b-4069-88d8-b617f35f13c1 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:25:39 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-d53b5efe-5b3b-4069-88d8-b617f35f13c1 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:25:39 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-d53b5efe-5b3b-4069-88d8-b617f35f13c1 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:25:39 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d53b5efe-5b3b-4069-88d8-b617f35f13c1 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 200 len: 1275 microversion: 2.20 time: 0.072119 Apr 14 03:25:39 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 332/1000] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:25:39 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 1275 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:25:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3ea9952f-212e-4ada-a1fd-45d56fbe3118 req-3b578bf7-c393-4e06-b95f-9d14be9fefe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3ea9952f-212e-4ada-a1fd-45d56fbe3118 req-3b578bf7-c393-4e06-b95f-9d14be9fefe8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3ea9952f-212e-4ada-a1fd-45d56fbe3118 req-3b578bf7-c393-4e06-b95f-9d14be9fefe8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3ea9952f-212e-4ada-a1fd-45d56fbe3118 req-3b578bf7-c393-4e06-b95f-9d14be9fefe8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3ea9952f-212e-4ada-a1fd-45d56fbe3118 req-3b578bf7-c393-4e06-b95f-9d14be9fefe8 service nova] Creating event network-changed:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:25:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3ea9952f-212e-4ada-a1fd-45d56fbe3118 req-3b578bf7-c393-4e06-b95f-9d14be9fefe8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034730 Apr 14 03:25:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 335/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-be9e1157-0342-4d10-baff-34a52461cb08 req-18a02b56-3a51-42c7-8d39-8535900d4151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-be9e1157-0342-4d10-baff-34a52461cb08 req-18a02b56-3a51-42c7-8d39-8535900d4151 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-be9e1157-0342-4d10-baff-34a52461cb08 req-18a02b56-3a51-42c7-8d39-8535900d4151 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-be9e1157-0342-4d10-baff-34a52461cb08 req-18a02b56-3a51-42c7-8d39-8535900d4151 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-be9e1157-0342-4d10-baff-34a52461cb08 req-18a02b56-3a51-42c7-8d39-8535900d4151 service nova] Creating event network-changed:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:25:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-be9e1157-0342-4d10-baff-34a52461cb08 req-18a02b56-3a51-42c7-8d39-8535900d4151 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086251 Apr 14 03:25:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 335/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:42 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-96956be4-4d4f-4610-a436-8f15a23af01f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1930339280"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:42 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-96956be4-4d4f-4610-a436-8f15a23af01f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96956be4-4d4f-4610-a436-8f15a23af01f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96956be4-4d4f-4610-a436-8f15a23af01f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96956be4-4d4f-4610-a436-8f15a23af01f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96956be4-4d4f-4610-a436-8f15a23af01f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96956be4-4d4f-4610-a436-8f15a23af01f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:42 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-96956be4-4d4f-4610-a436-8f15a23af01f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:43 user devstack@n-api.service[61662]: INFO nova.network.security_group_api [None req-96956be4-4d4f-4610-a436-8f15a23af01f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Adding security group 03fc1bce-3352-40be-89c0-3c9eade7ce5d to port 8a4c167f-3166-4f90-91c9-1a1d5be3c92d Apr 14 03:25:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-96956be4-4d4f-4610-a436-8f15a23af01f tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/action" status: 202 len: 0 microversion: 2.1 time: 0.890540 Apr 14 03:25:43 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 333/1003] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:25:42 2023] POST /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:25:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c644d297-9601-4f70-bad3-b326ca000ebc tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:25:43 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c644d297-9601-4f70-bad3-b326ca000ebc tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c644d297-9601-4f70-bad3-b326ca000ebc tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c644d297-9601-4f70-bad3-b326ca000ebc tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c644d297-9601-4f70-bad3-b326ca000ebc tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c644d297-9601-4f70-bad3-b326ca000ebc tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c644d297-9601-4f70-bad3-b326ca000ebc tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c644d297-9601-4f70-bad3-b326ca000ebc tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:44 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c644d297-9601-4f70-bad3-b326ca000ebc tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:25:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c644d297-9601-4f70-bad3-b326ca000ebc tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 200 len: 1747 microversion: 2.1 time: 0.257730 Apr 14 03:25:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 336/1004] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:25:43 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 1747 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:25:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-83d8ce35-c4c5-4731-90c4-15afa33f2aa1 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:44 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-83d8ce35-c4c5-4731-90c4-15afa33f2aa1 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83d8ce35-c4c5-4731-90c4-15afa33f2aa1 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83d8ce35-c4c5-4731-90c4-15afa33f2aa1 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83d8ce35-c4c5-4731-90c4-15afa33f2aa1 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83d8ce35-c4c5-4731-90c4-15afa33f2aa1 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83d8ce35-c4c5-4731-90c4-15afa33f2aa1 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-83d8ce35-c4c5-4731-90c4-15afa33f2aa1 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-83d8ce35-c4c5-4731-90c4-15afa33f2aa1 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/action" status: 202 len: 0 microversion: 2.1 time: 0.087686 Apr 14 03:25:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 336/1005] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:25:44 2023] POST /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:25:44 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-4f20a096-24e2-4462-9f84-7f8ecad5f169 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:25:44 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-4f20a096-24e2-4462-9f84-7f8ecad5f169 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4f20a096-24e2-4462-9f84-7f8ecad5f169 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4f20a096-24e2-4462-9f84-7f8ecad5f169 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4f20a096-24e2-4462-9f84-7f8ecad5f169 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4f20a096-24e2-4462-9f84-7f8ecad5f169 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4f20a096-24e2-4462-9f84-7f8ecad5f169 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:44 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-4f20a096-24e2-4462-9f84-7f8ecad5f169 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-9b42c355-74e3-415a-a3bb-19e6750af7d1 req-573fac55-f586-42c8-8be4-a76b39bb9c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:44 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-4f20a096-24e2-4462-9f84-7f8ecad5f169 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:25:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9b42c355-74e3-415a-a3bb-19e6750af7d1 req-573fac55-f586-42c8-8be4-a76b39bb9c13 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9b42c355-74e3-415a-a3bb-19e6750af7d1 req-573fac55-f586-42c8-8be4-a76b39bb9c13 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9b42c355-74e3-415a-a3bb-19e6750af7d1 req-573fac55-f586-42c8-8be4-a76b39bb9c13 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:44 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-4f20a096-24e2-4462-9f84-7f8ecad5f169 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 200 len: 1739 microversion: 2.1 time: 0.263601 Apr 14 03:25:44 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 334/1006] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:25:44 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:25:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-9b42c355-74e3-415a-a3bb-19e6750af7d1 req-573fac55-f586-42c8-8be4-a76b39bb9c13 service nova] Creating event network-changed:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:25:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-9b42c355-74e3-415a-a3bb-19e6750af7d1 req-573fac55-f586-42c8-8be4-a76b39bb9c13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048120 Apr 14 03:25:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 337/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-8f43f8da-1e59-4512-93f3-32122d6fd11f req-24bb8a65-d602-4196-93e2-8ac4fc182523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "name": "network-vif-plugged", "status": "completed", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}, {"server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "name": "network-vif-plugged", "status": "completed", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8f43f8da-1e59-4512-93f3-32122d6fd11f req-24bb8a65-d602-4196-93e2-8ac4fc182523 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8f43f8da-1e59-4512-93f3-32122d6fd11f req-24bb8a65-d602-4196-93e2-8ac4fc182523 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8f43f8da-1e59-4512-93f3-32122d6fd11f req-24bb8a65-d602-4196-93e2-8ac4fc182523 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-8f43f8da-1e59-4512-93f3-32122d6fd11f req-24bb8a65-d602-4196-93e2-8ac4fc182523 service nova] Creating event network-vif-plugged:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:25:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-8f43f8da-1e59-4512-93f3-32122d6fd11f req-24bb8a65-d602-4196-93e2-8ac4fc182523 service nova] Creating event network-vif-plugged:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:25:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-8f43f8da-1e59-4512-93f3-32122d6fd11f req-24bb8a65-d602-4196-93e2-8ac4fc182523 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029958 Apr 14 03:25:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 337/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:47 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-676a721d-62ce-43f7-a1c4-6a33e0a09ae1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:25:47 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-676a721d-62ce-43f7-a1c4-6a33e0a09ae1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-676a721d-62ce-43f7-a1c4-6a33e0a09ae1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-676a721d-62ce-43f7-a1c4-6a33e0a09ae1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-676a721d-62ce-43f7-a1c4-6a33e0a09ae1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-676a721d-62ce-43f7-a1c4-6a33e0a09ae1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-676a721d-62ce-43f7-a1c4-6a33e0a09ae1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-676a721d-62ce-43f7-a1c4-6a33e0a09ae1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:47 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-676a721d-62ce-43f7-a1c4-6a33e0a09ae1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:25:47 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-676a721d-62ce-43f7-a1c4-6a33e0a09ae1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4" status: 200 len: 1544 microversion: 2.1 time: 0.160050 Apr 14 03:25:47 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 335/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:25:47 2023] GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4 => generated 1544 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:25:47 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-6d6dc222-0a6b-40f9-ba68-a29e5f9a18d6 req-8afb9e6b-2764-4ddc-a927-04e8e5dc00af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "name": "network-vif-unplugged", "status": "completed", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6d6dc222-0a6b-40f9-ba68-a29e5f9a18d6 req-8afb9e6b-2764-4ddc-a927-04e8e5dc00af service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6d6dc222-0a6b-40f9-ba68-a29e5f9a18d6 req-8afb9e6b-2764-4ddc-a927-04e8e5dc00af service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6d6dc222-0a6b-40f9-ba68-a29e5f9a18d6 req-8afb9e6b-2764-4ddc-a927-04e8e5dc00af service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-6d6dc222-0a6b-40f9-ba68-a29e5f9a18d6 req-8afb9e6b-2764-4ddc-a927-04e8e5dc00af service nova] Creating event network-vif-unplugged:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:25:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-6d6dc222-0a6b-40f9-ba68-a29e5f9a18d6 req-8afb9e6b-2764-4ddc-a927-04e8e5dc00af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058111 Apr 14 03:25:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 338/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:25:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] [instance: 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:25:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] HTTP exception thrown: Instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 could not be found. Apr 14 03:25:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Request method failure captured: Apr 14 03:25:49 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 HTTP/1.1 Apr 14 03:25:49 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:25:49 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:25:49 user devstack@n-api.service[61664]: Connection: close Apr 14 03:25:49 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:25:49 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:25:49 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:25:49 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:25:49 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMcZeMU_TfJxxdxrsEB4QY685gPEc2q7i4TJ3_oUW3ie3eNQaGecGfVaaUrrL0mInzlWrhfar5MWPEVHlSrvvDzeMm-1nYBCP2Ha2W2rh9YK6DfZvtDzWnzvG2jMmI4y3NKx9vIIB799rFmN3110Soutaea1tO306KsotoeFfLJanTk Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Project-Id: 1ccb5ceb9f7641a9b6265de1f3c38c89 Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesNegativeTest-1844013062 Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ccb5ceb9f7641a9b6265de1f3c38c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ccb5ceb9f7641a9b6265de1f3c38c89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ccb5ceb9f7641a9b6265de1f3c38c89"}]}] Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesNegativeTest-1844013062 Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Tenant-Id: 1ccb5ceb9f7641a9b6265de1f3c38c89 Apr 14 03:25:49 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesNegativeTest-1844013062 Apr 14 03:25:49 user devstack@n-api.service[61664]: X-User: tempest-VolumesNegativeTest-1844013062-project-member Apr 14 03:25:49 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:25:49 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:25:49 user devstack@n-api.service[61664]: X-User-Id: 85a2f927a9b94b6a8e9d91932bab0af6 Apr 14 03:25:49 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesNegativeTest-1844013062-project-member Apr 14 03:25:49 user devstack@n-api.service[61664]: method: > Apr 14 03:25:49 user devstack@n-api.service[61664]: exception: Instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 could not be found. Apr 14 03:25:49 user devstack@n-api.service[61664]: action_args: {'id': '864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420'} Apr 14 03:25:49 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 could not be found. Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 could not be found. Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 could not be found. Apr 14 03:25:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:25:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] Returning 404 to user: Instance 864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:25:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4370a34f-e4aa-4d42-bf15-638582d33a42 tempest-VolumesNegativeTest-1844013062 tempest-VolumesNegativeTest-1844013062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420" status: 404 len: 111 microversion: 2.1 time: 0.037998 Apr 14 03:25:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 338/1011] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:25:49 2023] GET /compute/v2.1/servers/864cbb2e-a7cb-4cc3-beab-a9b4e1cbe420 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:25:49 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-e41a695a-eb12-413a-a406-a14d90569321 req-d3a2579e-1b29-4f59-8058-140b70dce339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "name": "network-vif-plugged", "status": "completed", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e41a695a-eb12-413a-a406-a14d90569321 req-d3a2579e-1b29-4f59-8058-140b70dce339 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e41a695a-eb12-413a-a406-a14d90569321 req-d3a2579e-1b29-4f59-8058-140b70dce339 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:49 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-e41a695a-eb12-413a-a406-a14d90569321 req-d3a2579e-1b29-4f59-8058-140b70dce339 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-e41a695a-eb12-413a-a406-a14d90569321 req-d3a2579e-1b29-4f59-8058-140b70dce339 service nova] Creating event network-vif-plugged:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:25:49 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-e41a695a-eb12-413a-a406-a14d90569321 req-d3a2579e-1b29-4f59-8058-140b70dce339 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049440 Apr 14 03:25:49 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 336/1012] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:25:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-6a05f9fe-2603-4a38-b633-0a22dede53d1 req-a877f54d-1124-4723-b38b-b7f845778c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "name": "network-vif-plugged", "status": "completed", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}, {"server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "name": "network-vif-plugged", "status": "completed", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:25:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6a05f9fe-2603-4a38-b633-0a22dede53d1 req-a877f54d-1124-4723-b38b-b7f845778c40 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:25:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6a05f9fe-2603-4a38-b633-0a22dede53d1 req-a877f54d-1124-4723-b38b-b7f845778c40 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:25:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6a05f9fe-2603-4a38-b633-0a22dede53d1 req-a877f54d-1124-4723-b38b-b7f845778c40 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:25:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-6a05f9fe-2603-4a38-b633-0a22dede53d1 req-a877f54d-1124-4723-b38b-b7f845778c40 service nova] Creating event network-vif-plugged:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:25:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-6a05f9fe-2603-4a38-b633-0a22dede53d1 req-a877f54d-1124-4723-b38b-b7f845778c40 service nova] Creating event network-vif-plugged:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:25:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-6a05f9fe-2603-4a38-b633-0a22dede53d1 req-a877f54d-1124-4723-b38b-b7f845778c40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.470765 Apr 14 03:25:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 339/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:25:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:26:13 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:13 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:13 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:13 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f020ad92-5bf9-4dc5-8b12-e134e319ea47 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Action: 'create', calling method: .version_select at 0x7ff11a4c5a20>, body: {"keypair": {"name": "tempest-TestShelveInstance-472203162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaRzDIjymQDKgKuJGVKrY9YoDm6sxEMtltnJTNSG+jb5Yzbpdqb24ukF2QSYjCu5ZtFM9xpqKafHtv/J2C+itYCqUfzijhnmtqKn1C/3bTReImbLmTyuHqlHmJ8FHo8QQ=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:26:13 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-f020ad92-5bf9-4dc5-8b12-e134e319ea47 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Getting quotas for project 1e0979cf1834435bb0007899da52e863. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:26:13 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-f020ad92-5bf9-4dc5-8b12-e134e319ea47 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Getting quotas for user 61f477304a044148ade1c6acffd30712 and project 1e0979cf1834435bb0007899da52e863. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:26:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f020ad92-5bf9-4dc5-8b12-e134e319ea47 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.337590 Apr 14 03:26:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 339/1014] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:26:13 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:26:18 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:18 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:18 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=18 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:18 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1348709575", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-472203162", "security_groups": [{"name": "tempest-secgroup-smoke-1811956754"}], "networks": [{"uuid": "f0e6e99b-d215-4622-9a1c-028eca82f6a0"}], "block_device_mapping_v2": [{"uuid": "3a8e1f1a-36b6-47b7-95f2-d31cd1b55808", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] validate_networks() for [('f0e6e99b-d215-4622-9a1c-028eca82f6a0', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Getting quotas for project 1e0979cf1834435bb0007899da52e863. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Getting quotas for user 61f477304a044148ade1c6acffd30712 and project 1e0979cf1834435bb0007899da52e863. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:26:19 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3a8e1f1a-36b6-47b7-95f2-d31cd1b55808',volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:26:19 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.825604 Apr 14 03:26:19 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 337/1015] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:26:18 2023] POST /compute/v2.1/servers => generated 404 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:26:19 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=16 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:19 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-224a180d-d336-4d2d-9c23-4c3f241814e0 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:26:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-224a180d-d336-4d2d-9c23-4c3f241814e0 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:26:19 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-224a180d-d336-4d2d-9c23-4c3f241814e0 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f477304a044148ade1c6acffd30712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0979cf1834435bb0007899da52e863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:26:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-224a180d-d336-4d2d-9c23-4c3f241814e0 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0" status: 200 len: 1083 microversion: 2.1 time: 0.070924 Apr 14 03:26:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 340/1016] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:26:19 2023] GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 => generated 1083 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:26:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-480f078a-0545-4b25-927f-d0909c345791 req-50723075-77a4-407e-9bd6-e7138bfba36d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:26:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-480f078a-0545-4b25-927f-d0909c345791 req-50723075-77a4-407e-9bd6-e7138bfba36d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-480f078a-0545-4b25-927f-d0909c345791 req-50723075-77a4-407e-9bd6-e7138bfba36d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-480f078a-0545-4b25-927f-d0909c345791 req-50723075-77a4-407e-9bd6-e7138bfba36d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-480f078a-0545-4b25-927f-d0909c345791 req-50723075-77a4-407e-9bd6-e7138bfba36d service nova] Creating event network-changed:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:26:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-480f078a-0545-4b25-927f-d0909c345791 req-50723075-77a4-407e-9bd6-e7138bfba36d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033118 Apr 14 03:26:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 340/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:26:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:26:28 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-440a7f59-e563-41ec-8ab8-47def873e19e req-e6182649-758d-43ac-8b88-984601902ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "name": "network-vif-plugged", "status": "completed", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:26:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-440a7f59-e563-41ec-8ab8-47def873e19e req-e6182649-758d-43ac-8b88-984601902ed7 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-440a7f59-e563-41ec-8ab8-47def873e19e req-e6182649-758d-43ac-8b88-984601902ed7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:28 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-440a7f59-e563-41ec-8ab8-47def873e19e req-e6182649-758d-43ac-8b88-984601902ed7 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:28 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-440a7f59-e563-41ec-8ab8-47def873e19e req-e6182649-758d-43ac-8b88-984601902ed7 service nova] Creating event network-vif-plugged:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:26:28 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-440a7f59-e563-41ec-8ab8-47def873e19e req-e6182649-758d-43ac-8b88-984601902ed7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037219 Apr 14 03:26:28 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 338/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:26:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:26:30 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:26:30 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-853fa290-6450-4fc7-b9a8-6f58d313c26c tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 200 len: 1586 microversion: 2.20 time: 0.178529 Apr 14 03:26:30 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 341/1019] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:26:29 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 1586 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:26:30 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-27649f39-a149-4e4d-bcc2-7ac82740c9fe req-752e3467-1f78-433c-9369-580be0f87add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "name": "network-vif-plugged", "status": "completed", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:26:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-27649f39-a149-4e4d-bcc2-7ac82740c9fe req-752e3467-1f78-433c-9369-580be0f87add service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-27649f39-a149-4e4d-bcc2-7ac82740c9fe req-752e3467-1f78-433c-9369-580be0f87add service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-27649f39-a149-4e4d-bcc2-7ac82740c9fe req-752e3467-1f78-433c-9369-580be0f87add service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-27649f39-a149-4e4d-bcc2-7ac82740c9fe req-752e3467-1f78-433c-9369-580be0f87add service nova] Creating event network-vif-plugged:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:26:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-27649f39-a149-4e4d-bcc2-7ac82740c9fe req-752e3467-1f78-433c-9369-580be0f87add service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030375 Apr 14 03:26:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 341/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:26:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-b71699b6-8c17-4cd8-afdf-9a2e3ea3ee3d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-b71699b6-8c17-4cd8-afdf-9a2e3ea3ee3d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b71699b6-8c17-4cd8-afdf-9a2e3ea3ee3d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b71699b6-8c17-4cd8-afdf-9a2e3ea3ee3d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b71699b6-8c17-4cd8-afdf-9a2e3ea3ee3d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b71699b6-8c17-4cd8-afdf-9a2e3ea3ee3d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b71699b6-8c17-4cd8-afdf-9a2e3ea3ee3d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-b71699b6-8c17-4cd8-afdf-9a2e3ea3ee3d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:34 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-b71699b6-8c17-4cd8-afdf-9a2e3ea3ee3d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:26:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-b71699b6-8c17-4cd8-afdf-9a2e3ea3ee3d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 200 len: 1747 microversion: 2.1 time: 0.201857 Apr 14 03:26:34 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 339/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:26:34 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 1747 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:26:47 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-26e29380-b95c-492d-af13-b23652ae72c0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:26:47 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-26e29380-b95c-492d-af13-b23652ae72c0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:26:47 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:47 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-26e29380-b95c-492d-af13-b23652ae72c0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-26e29380-b95c-492d-af13-b23652ae72c0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-26e29380-b95c-492d-af13-b23652ae72c0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-26e29380-b95c-492d-af13-b23652ae72c0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-26e29380-b95c-492d-af13-b23652ae72c0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-26e29380-b95c-492d-af13-b23652ae72c0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-26e29380-b95c-492d-af13-b23652ae72c0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.095206 Apr 14 03:26:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 342/1022] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:26:47 2023] GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-interface => generated 282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:26:48 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:48 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d5332d43-8ce1-49de-8e5b-0d9662260a61 req-69a0dc79-a6a6-43c6-a928-1e336f2c49c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82dc7444-2886-4be4-b565-99e1cb0a70e4", "tag": "08a928bc-74c8-42cf-92a5-f3470037e540"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:26:48 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:48 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=10 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d5332d43-8ce1-49de-8e5b-0d9662260a61 req-69a0dc79-a6a6-43c6-a928-1e336f2c49c3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d5332d43-8ce1-49de-8e5b-0d9662260a61 req-69a0dc79-a6a6-43c6-a928-1e336f2c49c3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d5332d43-8ce1-49de-8e5b-0d9662260a61 req-69a0dc79-a6a6-43c6-a928-1e336f2c49c3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:48 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-acaf8679-b865-4fb1-8f89-15dc1dd78ea6 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:26:48 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-acaf8679-b865-4fb1-8f89-15dc1dd78ea6 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:26:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-acaf8679-b865-4fb1-8f89-15dc1dd78ea6 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-acaf8679-b865-4fb1-8f89-15dc1dd78ea6 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-acaf8679-b865-4fb1-8f89-15dc1dd78ea6 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-acaf8679-b865-4fb1-8f89-15dc1dd78ea6 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-acaf8679-b865-4fb1-8f89-15dc1dd78ea6 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-acaf8679-b865-4fb1-8f89-15dc1dd78ea6 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d5332d43-8ce1-49de-8e5b-0d9662260a61 req-69a0dc79-a6a6-43c6-a928-1e336f2c49c3 service nova] Creating event network-changed:08a928bc-74c8-42cf-92a5-f3470037e540 for instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 on user Apr 14 03:26:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d5332d43-8ce1-49de-8e5b-0d9662260a61 req-69a0dc79-a6a6-43c6-a928-1e336f2c49c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078316 Apr 14 03:26:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 342/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:26:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:26:48 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-acaf8679-b865-4fb1-8f89-15dc1dd78ea6 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/ips" status: 200 len: 108 microversion: 2.1 time: 0.042026 Apr 14 03:26:48 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 340/1024] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 03:26:48 2023] GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/ips => generated 108 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:26:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-55017929-b33b-45bd-81cb-0fe8c6267b2d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ef98f79-a820-44e4-bde2-010a709dc93c"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:26:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-55017929-b33b-45bd-81cb-0fe8c6267b2d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:26:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-55017929-b33b-45bd-81cb-0fe8c6267b2d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-55017929-b33b-45bd-81cb-0fe8c6267b2d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-55017929-b33b-45bd-81cb-0fe8c6267b2d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-55017929-b33b-45bd-81cb-0fe8c6267b2d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-55017929-b33b-45bd-81cb-0fe8c6267b2d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-55017929-b33b-45bd-81cb-0fe8c6267b2d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-55017929-b33b-45bd-81cb-0fe8c6267b2d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657475 Apr 14 03:26:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 343/1025] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:26:51 2023] POST /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:26:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ef98f79-a820-44e4-bde2-010a709dc93c"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:26:58 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:26:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Invalid volume: volume 7ef98f79-a820-44e4-bde2-010a709dc93c is already attached to instances: 82dc7444-2886-4be4-b565-99e1cb0a70e4 Apr 14 03:26:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:26:58 user devstack@n-api.service[61664]: request: POST /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments HTTP/1.1 Apr 14 03:26:58 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:26:58 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:26:58 user devstack@n-api.service[61664]: Connection: close Apr 14 03:26:58 user devstack@n-api.service[61664]: Content-Length: 74 Apr 14 03:26:58 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:26:58 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:26:58 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:26:58 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:26:58 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:26:58 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:26:58 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:26:58 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:26:58 user devstack@n-api.service[61664]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:26:58 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:26:58 user devstack@n-api.service[61664]: Apr 14 03:26:58 user devstack@n-api.service[61664]: {"volumeAttachment": {"volumeId": "7ef98f79-a820-44e4-bde2-010a709dc93c"}} Apr 14 03:26:58 user devstack@n-api.service[61664]: method: > Apr 14 03:26:58 user devstack@n-api.service[61664]: exception: Invalid volume: volume 7ef98f79-a820-44e4-bde2-010a709dc93c is already attached to instances: 82dc7444-2886-4be4-b565-99e1cb0a70e4 Apr 14 03:26:58 user devstack@n-api.service[61664]: action_args: {'server_id': '82dc7444-2886-4be4-b565-99e1cb0a70e4', 'body': {'volumeAttachment': {'volumeId': '7ef98f79-a820-44e4-bde2-010a709dc93c'}}} Apr 14 03:26:58 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7ef98f79-a820-44e4-bde2-010a709dc93c is already attached to instances: 82dc7444-2886-4be4-b565-99e1cb0a70e4 Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7ef98f79-a820-44e4-bde2-010a709dc93c is already attached to instances: 82dc7444-2886-4be4-b565-99e1cb0a70e4 Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7ef98f79-a820-44e4-bde2-010a709dc93c is already attached to instances: 82dc7444-2886-4be4-b565-99e1cb0a70e4 Apr 14 03:26:58 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:26:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 400 to user: Invalid volume: volume 7ef98f79-a820-44e4-bde2-010a709dc93c is already attached to instances: 82dc7444-2886-4be4-b565-99e1cb0a70e4 {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:26:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-28ed094f-85e1-4b7a-8e9c-eb722a9be2e3 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114916 Apr 14 03:26:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 343/1026] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:26:58 2023] POST /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:26:58 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-e18747fa-f296-4ff7-bc91-6b6c2779f168 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:26:58 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-e18747fa-f296-4ff7-bc91-6b6c2779f168 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:26:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e18747fa-f296-4ff7-bc91-6b6c2779f168 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e18747fa-f296-4ff7-bc91-6b6c2779f168 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e18747fa-f296-4ff7-bc91-6b6c2779f168 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e18747fa-f296-4ff7-bc91-6b6c2779f168 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e18747fa-f296-4ff7-bc91-6b6c2779f168 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:58 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e18747fa-f296-4ff7-bc91-6b6c2779f168 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:58 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-e18747fa-f296-4ff7-bc91-6b6c2779f168 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lazy-loading 'services' on Instance uuid 82dc7444-2886-4be4-b565-99e1cb0a70e4 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:26:58 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-e18747fa-f296-4ff7-bc91-6b6c2779f168 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments/7ef98f79-a820-44e4-bde2-010a709dc93c" status: 202 len: 0 microversion: 2.1 time: 0.184607 Apr 14 03:26:58 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 341/1027] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:26:58 2023] DELETE /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments/7ef98f79-a820-44e4-bde2-010a709dc93c => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:26:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-223494d5-ffdd-4fcd-af2d-aaa89d6787ed tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:26:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-223494d5-ffdd-4fcd-af2d-aaa89d6787ed tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:26:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-223494d5-ffdd-4fcd-af2d-aaa89d6787ed tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-223494d5-ffdd-4fcd-af2d-aaa89d6787ed tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-223494d5-ffdd-4fcd-af2d-aaa89d6787ed tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-223494d5-ffdd-4fcd-af2d-aaa89d6787ed tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:26:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-223494d5-ffdd-4fcd-af2d-aaa89d6787ed tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:26:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-223494d5-ffdd-4fcd-af2d-aaa89d6787ed tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:26:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-223494d5-ffdd-4fcd-af2d-aaa89d6787ed tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057566 Apr 14 03:26:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 344/1028] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:26:58 2023] GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:27:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a5854236-4ba8-4168-800b-481cef066897 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:27:09 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a5854236-4ba8-4168-800b-481cef066897 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a5854236-4ba8-4168-800b-481cef066897 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a5854236-4ba8-4168-800b-481cef066897 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a5854236-4ba8-4168-800b-481cef066897 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a5854236-4ba8-4168-800b-481cef066897 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a5854236-4ba8-4168-800b-481cef066897 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a5854236-4ba8-4168-800b-481cef066897 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:10 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a5854236-4ba8-4168-800b-481cef066897 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f477304a044148ade1c6acffd30712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0979cf1834435bb0007899da52e863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:27:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a5854236-4ba8-4168-800b-481cef066897 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0" status: 200 len: 1433 microversion: 2.1 time: 0.208936 Apr 14 03:27:10 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 344/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:27:09 2023] GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 => generated 1433 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 03:27:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:30 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:30 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-bf27e130-5441-4986-8130-989dc3fa9c5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:27:30 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-bf27e130-5441-4986-8130-989dc3fa9c5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf27e130-5441-4986-8130-989dc3fa9c5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf27e130-5441-4986-8130-989dc3fa9c5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf27e130-5441-4986-8130-989dc3fa9c5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf27e130-5441-4986-8130-989dc3fa9c5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf27e130-5441-4986-8130-989dc3fa9c5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:30 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-bf27e130-5441-4986-8130-989dc3fa9c5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:30 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-bf27e130-5441-4986-8130-989dc3fa9c5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.123279 Apr 14 03:27:30 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 342/1030] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 03:27:30 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-interface => generated 282 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:27:31 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:31 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-4d3d05aa-1adb-42b0-ac40-2c896ccfbff8 req-ca8bcef3-8542-463a-abb4-ea54ed94eb3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d3d05aa-1adb-42b0-ac40-2c896ccfbff8 req-ca8bcef3-8542-463a-abb4-ea54ed94eb3a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d3d05aa-1adb-42b0-ac40-2c896ccfbff8 req-ca8bcef3-8542-463a-abb4-ea54ed94eb3a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d3d05aa-1adb-42b0-ac40-2c896ccfbff8 req-ca8bcef3-8542-463a-abb4-ea54ed94eb3a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-4d3d05aa-1adb-42b0-ac40-2c896ccfbff8 req-ca8bcef3-8542-463a-abb4-ea54ed94eb3a service nova] Creating event network-changed:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:27:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-4d3d05aa-1adb-42b0-ac40-2c896ccfbff8 req-ca8bcef3-8542-463a-abb4-ea54ed94eb3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041989 Apr 14 03:27:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 345/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:27:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:27:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-15850674-a832-46d8-a1c0-96244231326f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:27:31 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-15850674-a832-46d8-a1c0-96244231326f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:31 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:31 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15850674-a832-46d8-a1c0-96244231326f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15850674-a832-46d8-a1c0-96244231326f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15850674-a832-46d8-a1c0-96244231326f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15850674-a832-46d8-a1c0-96244231326f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15850674-a832-46d8-a1c0-96244231326f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15850674-a832-46d8-a1c0-96244231326f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-15850674-a832-46d8-a1c0-96244231326f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/ips" status: 200 len: 109 microversion: 2.20 time: 0.053955 Apr 14 03:27:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 345/1032] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 03:27:31 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/ips => generated 109 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:27:33 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-122209b6-d57e-4c3d-8ab0-5ff9cbe1bdeb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:33 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-122209b6-d57e-4c3d-8ab0-5ff9cbe1bdeb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-122209b6-d57e-4c3d-8ab0-5ff9cbe1bdeb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-122209b6-d57e-4c3d-8ab0-5ff9cbe1bdeb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-122209b6-d57e-4c3d-8ab0-5ff9cbe1bdeb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-122209b6-d57e-4c3d-8ab0-5ff9cbe1bdeb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-122209b6-d57e-4c3d-8ab0-5ff9cbe1bdeb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-122209b6-d57e-4c3d-8ab0-5ff9cbe1bdeb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:33 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-122209b6-d57e-4c3d-8ab0-5ff9cbe1bdeb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lazy-loading 'flavor' on Instance uuid 16e9b236-ce8f-4231-af55-e694bc43dde4 {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:27:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-122209b6-d57e-4c3d-8ab0-5ff9cbe1bdeb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/action" status: 202 len: 0 microversion: 2.20 time: 0.907548 Apr 14 03:27:34 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 343/1033] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 03:27:33 2023] POST /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/action => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:27:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:27:34 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-aa99a0c2-54c7-4ed3-beb1-c8567dcf5176 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1930339280"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:34 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-aa99a0c2-54c7-4ed3-beb1-c8567dcf5176 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa99a0c2-54c7-4ed3-beb1-c8567dcf5176 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa99a0c2-54c7-4ed3-beb1-c8567dcf5176 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa99a0c2-54c7-4ed3-beb1-c8567dcf5176 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa99a0c2-54c7-4ed3-beb1-c8567dcf5176 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa99a0c2-54c7-4ed3-beb1-c8567dcf5176 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aa99a0c2-54c7-4ed3-beb1-c8567dcf5176 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:35 user devstack@n-api.service[61664]: INFO nova.network.security_group_api [None req-aa99a0c2-54c7-4ed3-beb1-c8567dcf5176 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Removing security group 03fc1bce-3352-40be-89c0-3c9eade7ce5d from port 8a4c167f-3166-4f90-91c9-1a1d5be3c92d Apr 14 03:27:35 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:27:35 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:27:35 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:27:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0adbbc28-5c50-47af-a85c-9f96161e3c65 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 200 len: 1710 microversion: 2.20 time: 0.329801 Apr 14 03:27:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 346/1034] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:27:34 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 1710 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:27:35 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-efa17adf-e46f-4b29-9948-da160d9f8c6a req-a9283ce2-ea0b-478f-a87d-55fe461025d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "name": "network-vif-unplugged", "status": "completed", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-efa17adf-e46f-4b29-9948-da160d9f8c6a req-a9283ce2-ea0b-478f-a87d-55fe461025d9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-efa17adf-e46f-4b29-9948-da160d9f8c6a req-a9283ce2-ea0b-478f-a87d-55fe461025d9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-efa17adf-e46f-4b29-9948-da160d9f8c6a req-a9283ce2-ea0b-478f-a87d-55fe461025d9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-efa17adf-e46f-4b29-9948-da160d9f8c6a req-a9283ce2-ea0b-478f-a87d-55fe461025d9 service nova] Creating event network-vif-unplugged:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:27:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-efa17adf-e46f-4b29-9948-da160d9f8c6a req-a9283ce2-ea0b-478f-a87d-55fe461025d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030431 Apr 14 03:27:35 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 344/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:27:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:27:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-aa99a0c2-54c7-4ed3-beb1-c8567dcf5176 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/action" status: 202 len: 0 microversion: 2.1 time: 0.648838 Apr 14 03:27:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 346/1036] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:27:34 2023] POST /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:27:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-42db0955-d44f-42ca-ae65-b777f9524ffd req-2f7c8b47-b884-4a7c-a3ea-bc47874a87a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-42db0955-d44f-42ca-ae65-b777f9524ffd req-2f7c8b47-b884-4a7c-a3ea-bc47874a87a1 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-42db0955-d44f-42ca-ae65-b777f9524ffd req-2f7c8b47-b884-4a7c-a3ea-bc47874a87a1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-42db0955-d44f-42ca-ae65-b777f9524ffd req-2f7c8b47-b884-4a7c-a3ea-bc47874a87a1 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-42db0955-d44f-42ca-ae65-b777f9524ffd req-2f7c8b47-b884-4a7c-a3ea-bc47874a87a1 service nova] Creating event network-changed:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:27:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-42db0955-d44f-42ca-ae65-b777f9524ffd req-2f7c8b47-b884-4a7c-a3ea-bc47874a87a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035248 Apr 14 03:27:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 347/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:27:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:27:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-85284b7d-4b51-487d-847b-27ece93a8bc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:27:36 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-85284b7d-4b51-487d-847b-27ece93a8bc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-85284b7d-4b51-487d-847b-27ece93a8bc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-85284b7d-4b51-487d-847b-27ece93a8bc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-85284b7d-4b51-487d-847b-27ece93a8bc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-85284b7d-4b51-487d-847b-27ece93a8bc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-85284b7d-4b51-487d-847b-27ece93a8bc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-85284b7d-4b51-487d-847b-27ece93a8bc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:36 user devstack@n-api.service[61662]: DEBUG nova.objects.instance [None req-85284b7d-4b51-487d-847b-27ece93a8bc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lazy-loading 'services' on Instance uuid f8042c4c-0ff6-4533-8f59-de5c41ede33f {{(pid=61662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:27:36 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-85284b7d-4b51-487d-847b-27ece93a8bc6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments/5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f" status: 202 len: 0 microversion: 2.1 time: 0.163388 Apr 14 03:27:36 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 345/1038] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:27:36 2023] DELETE /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments/5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:27:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-06f1be88-c6d8-458e-944c-bb65d1dc87c6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:27:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-06f1be88-c6d8-458e-944c-bb65d1dc87c6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06f1be88-c6d8-458e-944c-bb65d1dc87c6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06f1be88-c6d8-458e-944c-bb65d1dc87c6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06f1be88-c6d8-458e-944c-bb65d1dc87c6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06f1be88-c6d8-458e-944c-bb65d1dc87c6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06f1be88-c6d8-458e-944c-bb65d1dc87c6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06f1be88-c6d8-458e-944c-bb65d1dc87c6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-06f1be88-c6d8-458e-944c-bb65d1dc87c6 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045548 Apr 14 03:27:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 347/1039] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:27:36 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:27:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-e06c30c1-2cde-4449-bc1c-03b30a9a0c92 req-8737b6cb-9513-43da-89d5-4b77cf2b8a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "name": "network-vif-plugged", "status": "completed", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e06c30c1-2cde-4449-bc1c-03b30a9a0c92 req-8737b6cb-9513-43da-89d5-4b77cf2b8a20 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e06c30c1-2cde-4449-bc1c-03b30a9a0c92 req-8737b6cb-9513-43da-89d5-4b77cf2b8a20 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e06c30c1-2cde-4449-bc1c-03b30a9a0c92 req-8737b6cb-9513-43da-89d5-4b77cf2b8a20 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e06c30c1-2cde-4449-bc1c-03b30a9a0c92 req-8737b6cb-9513-43da-89d5-4b77cf2b8a20 service nova] Creating event network-vif-plugged:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:27:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-e06c30c1-2cde-4449-bc1c-03b30a9a0c92 req-8737b6cb-9513-43da-89d5-4b77cf2b8a20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028642 Apr 14 03:27:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 348/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:27:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:27:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-9d1cb39e-57e1-4c8f-bb47-8a7747f36c9a req-3d3ce9a7-ffa4-46b2-a271-a0852e7588a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9d1cb39e-57e1-4c8f-bb47-8a7747f36c9a req-3d3ce9a7-ffa4-46b2-a271-a0852e7588a9 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9d1cb39e-57e1-4c8f-bb47-8a7747f36c9a req-3d3ce9a7-ffa4-46b2-a271-a0852e7588a9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-9d1cb39e-57e1-4c8f-bb47-8a7747f36c9a req-3d3ce9a7-ffa4-46b2-a271-a0852e7588a9 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-9d1cb39e-57e1-4c8f-bb47-8a7747f36c9a req-3d3ce9a7-ffa4-46b2-a271-a0852e7588a9 service nova] Creating event network-changed:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:27:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-9d1cb39e-57e1-4c8f-bb47-8a7747f36c9a req-3d3ce9a7-ffa4-46b2-a271-a0852e7588a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077838 Apr 14 03:27:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 346/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:27:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:27:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-4e895d41-877e-4b0a-9d97-9d1faede872a req-dbfaacbb-bd58-4d59-90ae-ba33d53aee40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4e895d41-877e-4b0a-9d97-9d1faede872a req-dbfaacbb-bd58-4d59-90ae-ba33d53aee40 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4e895d41-877e-4b0a-9d97-9d1faede872a req-dbfaacbb-bd58-4d59-90ae-ba33d53aee40 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4e895d41-877e-4b0a-9d97-9d1faede872a req-dbfaacbb-bd58-4d59-90ae-ba33d53aee40 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-4e895d41-877e-4b0a-9d97-9d1faede872a req-dbfaacbb-bd58-4d59-90ae-ba33d53aee40 service nova] Creating event network-changed:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:27:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-4e895d41-877e-4b0a-9d97-9d1faede872a req-dbfaacbb-bd58-4d59-90ae-ba33d53aee40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028917 Apr 14 03:27:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 348/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:27:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:27:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=12 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e43a2149-f22b-4e0c-bd23-b37f5acdf890 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:27:48 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e43a2149-f22b-4e0c-bd23-b37f5acdf890 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e43a2149-f22b-4e0c-bd23-b37f5acdf890 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e43a2149-f22b-4e0c-bd23-b37f5acdf890 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e43a2149-f22b-4e0c-bd23-b37f5acdf890 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e43a2149-f22b-4e0c-bd23-b37f5acdf890 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e43a2149-f22b-4e0c-bd23-b37f5acdf890 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e43a2149-f22b-4e0c-bd23-b37f5acdf890 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e43a2149-f22b-4e0c-bd23-b37f5acdf890 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047225 Apr 14 03:27:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 349/1043] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:27:48 2023] GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=10 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c1f9d874-08df-4ac8-98b2-7057eb498a9e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c1f9d874-08df-4ac8-98b2-7057eb498a9e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c1f9d874-08df-4ac8-98b2-7057eb498a9e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c1f9d874-08df-4ac8-98b2-7057eb498a9e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c1f9d874-08df-4ac8-98b2-7057eb498a9e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c1f9d874-08df-4ac8-98b2-7057eb498a9e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c1f9d874-08df-4ac8-98b2-7057eb498a9e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c1f9d874-08df-4ac8-98b2-7057eb498a9e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:48 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c1f9d874-08df-4ac8-98b2-7057eb498a9e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:27:48 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c1f9d874-08df-4ac8-98b2-7057eb498a9e tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4" status: 204 len: 0 microversion: 2.1 time: 0.129158 Apr 14 03:27:48 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 347/1044] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:27:48 2023] DELETE /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:27:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-be583f2d-9850-481b-a83e-840e335c3b59 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:27:48 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-be583f2d-9850-481b-a83e-840e335c3b59 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:27:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-be583f2d-9850-481b-a83e-840e335c3b59 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-be583f2d-9850-481b-a83e-840e335c3b59 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-be583f2d-9850-481b-a83e-840e335c3b59 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-be583f2d-9850-481b-a83e-840e335c3b59 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-be583f2d-9850-481b-a83e-840e335c3b59 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-be583f2d-9850-481b-a83e-840e335c3b59 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:49 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-be583f2d-9850-481b-a83e-840e335c3b59 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:27:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-be583f2d-9850-481b-a83e-840e335c3b59 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4" status: 200 len: 1668 microversion: 2.1 time: 0.160299 Apr 14 03:27:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 349/1045] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:27:48 2023] GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:27:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-03becbab-d694-42bd-957d-c8831ecb8253 req-221844f9-a1b9-4c1b-86fd-1d9fafe9f1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dc7444-2886-4be4-b565-99e1cb0a70e4", "name": "network-vif-unplugged", "status": "completed", "tag": "08a928bc-74c8-42cf-92a5-f3470037e540"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-03becbab-d694-42bd-957d-c8831ecb8253 req-221844f9-a1b9-4c1b-86fd-1d9fafe9f1c8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-03becbab-d694-42bd-957d-c8831ecb8253 req-221844f9-a1b9-4c1b-86fd-1d9fafe9f1c8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-03becbab-d694-42bd-957d-c8831ecb8253 req-221844f9-a1b9-4c1b-86fd-1d9fafe9f1c8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-03becbab-d694-42bd-957d-c8831ecb8253 req-221844f9-a1b9-4c1b-86fd-1d9fafe9f1c8 service nova] Creating event network-vif-unplugged:08a928bc-74c8-42cf-92a5-f3470037e540 for instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 on user Apr 14 03:27:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-03becbab-d694-42bd-957d-c8831ecb8253 req-221844f9-a1b9-4c1b-86fd-1d9fafe9f1c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029060 Apr 14 03:27:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 350/1046] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:27:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:27:50 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-8bdc9a98-aee4-420e-9e3c-3211991a3537 req-5d421647-7d74-4d78-ac6a-54eaf9c32534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dc7444-2886-4be4-b565-99e1cb0a70e4", "name": "network-vif-deleted", "tag": "08a928bc-74c8-42cf-92a5-f3470037e540"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8bdc9a98-aee4-420e-9e3c-3211991a3537 req-5d421647-7d74-4d78-ac6a-54eaf9c32534 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8bdc9a98-aee4-420e-9e3c-3211991a3537 req-5d421647-7d74-4d78-ac6a-54eaf9c32534 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-8bdc9a98-aee4-420e-9e3c-3211991a3537 req-5d421647-7d74-4d78-ac6a-54eaf9c32534 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-8bdc9a98-aee4-420e-9e3c-3211991a3537 req-5d421647-7d74-4d78-ac6a-54eaf9c32534 service nova] Creating event network-vif-deleted:08a928bc-74c8-42cf-92a5-f3470037e540 for instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 on user Apr 14 03:27:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-8bdc9a98-aee4-420e-9e3c-3211991a3537 req-5d421647-7d74-4d78-ac6a-54eaf9c32534 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035444 Apr 14 03:27:50 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 348/1047] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:27:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:27:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-7d9f0a9d-adb9-4b42-8adb-0f3470aaef18 req-54d90ffc-6cc6-411d-a5e1-86affde5699f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dc7444-2886-4be4-b565-99e1cb0a70e4", "name": "network-vif-plugged", "status": "completed", "tag": "08a928bc-74c8-42cf-92a5-f3470037e540"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:27:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7d9f0a9d-adb9-4b42-8adb-0f3470aaef18 req-54d90ffc-6cc6-411d-a5e1-86affde5699f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:27:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7d9f0a9d-adb9-4b42-8adb-0f3470aaef18 req-54d90ffc-6cc6-411d-a5e1-86affde5699f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:27:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7d9f0a9d-adb9-4b42-8adb-0f3470aaef18 req-54d90ffc-6cc6-411d-a5e1-86affde5699f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:27:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-7d9f0a9d-adb9-4b42-8adb-0f3470aaef18 req-54d90ffc-6cc6-411d-a5e1-86affde5699f service nova] Creating event network-vif-plugged:08a928bc-74c8-42cf-92a5-f3470037e540 for instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 on user Apr 14 03:27:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-7d9f0a9d-adb9-4b42-8adb-0f3470aaef18 req-54d90ffc-6cc6-411d-a5e1-86affde5699f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029824 Apr 14 03:27:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 350/1048] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:27:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d75d4240-78f3-4812-9bef-cc8fb1af7bad tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d75d4240-78f3-4812-9bef-cc8fb1af7bad tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d75d4240-78f3-4812-9bef-cc8fb1af7bad tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d75d4240-78f3-4812-9bef-cc8fb1af7bad tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d75d4240-78f3-4812-9bef-cc8fb1af7bad tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d75d4240-78f3-4812-9bef-cc8fb1af7bad tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d75d4240-78f3-4812-9bef-cc8fb1af7bad tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d75d4240-78f3-4812-9bef-cc8fb1af7bad tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:10 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-d75d4240-78f3-4812-9bef-cc8fb1af7bad tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f477304a044148ade1c6acffd30712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0979cf1834435bb0007899da52e863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:28:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d75d4240-78f3-4812-9bef-cc8fb1af7bad tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0" status: 200 len: 1433 microversion: 2.1 time: 0.338644 Apr 14 03:28:10 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 351/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:28:10 2023] GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 => generated 1433 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:28:12 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:12 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:12 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-b61199a9-3f4d-4d4e-bb85-783c1e5fba9b req-ee010787-2ae6-4519-91c8-765b4e2f78db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b61199a9-3f4d-4d4e-bb85-783c1e5fba9b req-ee010787-2ae6-4519-91c8-765b4e2f78db service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b61199a9-3f4d-4d4e-bb85-783c1e5fba9b req-ee010787-2ae6-4519-91c8-765b4e2f78db service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b61199a9-3f4d-4d4e-bb85-783c1e5fba9b req-ee010787-2ae6-4519-91c8-765b4e2f78db service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-b61199a9-3f4d-4d4e-bb85-783c1e5fba9b req-ee010787-2ae6-4519-91c8-765b4e2f78db service nova] Creating event network-changed:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:28:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-b61199a9-3f4d-4d4e-bb85-783c1e5fba9b req-ee010787-2ae6-4519-91c8-765b4e2f78db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040260 Apr 14 03:28:12 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 349/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:28:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=12 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=24 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-efcf0a7f-c9bf-428d-a017-4790e845a63a tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-efcf0a7f-c9bf-428d-a017-4790e845a63a tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efcf0a7f-c9bf-428d-a017-4790e845a63a tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efcf0a7f-c9bf-428d-a017-4790e845a63a tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efcf0a7f-c9bf-428d-a017-4790e845a63a tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efcf0a7f-c9bf-428d-a017-4790e845a63a tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efcf0a7f-c9bf-428d-a017-4790e845a63a tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-efcf0a7f-c9bf-428d-a017-4790e845a63a tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:12 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-efcf0a7f-c9bf-428d-a017-4790e845a63a tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lazy-loading 'flavor' on Instance uuid ce889d46-fac9-4f77-9d66-6e7753d8a0e0 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:28:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-efcf0a7f-c9bf-428d-a017-4790e845a63a tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0/action" status: 202 len: 0 microversion: 2.1 time: 0.113834 Apr 14 03:28:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 351/1051] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:28:12 2023] POST /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:28:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4016dfb9-dfbc-4d27-bec0-ab70b918b20f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:28:12 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4016dfb9-dfbc-4d27-bec0-ab70b918b20f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:28:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4016dfb9-dfbc-4d27-bec0-ab70b918b20f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4016dfb9-dfbc-4d27-bec0-ab70b918b20f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4016dfb9-dfbc-4d27-bec0-ab70b918b20f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4016dfb9-dfbc-4d27-bec0-ab70b918b20f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4016dfb9-dfbc-4d27-bec0-ab70b918b20f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4016dfb9-dfbc-4d27-bec0-ab70b918b20f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:12 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-5e74a5ad-80f7-4b83-af62-abd74bca04b1 req-baabc713-58a9-44be-9ee4-9ff2c5d53eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "name": "network-vif-unplugged", "status": "completed", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5e74a5ad-80f7-4b83-af62-abd74bca04b1 req-baabc713-58a9-44be-9ee4-9ff2c5d53eef service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5e74a5ad-80f7-4b83-af62-abd74bca04b1 req-baabc713-58a9-44be-9ee4-9ff2c5d53eef service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:12 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5e74a5ad-80f7-4b83-af62-abd74bca04b1 req-baabc713-58a9-44be-9ee4-9ff2c5d53eef service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-5e74a5ad-80f7-4b83-af62-abd74bca04b1 req-baabc713-58a9-44be-9ee4-9ff2c5d53eef service nova] Creating event network-vif-unplugged:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:28:12 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-5e74a5ad-80f7-4b83-af62-abd74bca04b1 req-baabc713-58a9-44be-9ee4-9ff2c5d53eef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031064 Apr 14 03:28:12 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 350/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:28:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:12 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4016dfb9-dfbc-4d27-bec0-ab70b918b20f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f477304a044148ade1c6acffd30712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0979cf1834435bb0007899da52e863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:28:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4016dfb9-dfbc-4d27-bec0-ab70b918b20f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0" status: 200 len: 1439 microversion: 2.1 time: 0.325541 Apr 14 03:28:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 352/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:28:12 2023] GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 => generated 1439 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:28:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f756b9bd-7c78-4334-b8bb-4e77633daeb4 req-9fd61480-e117-4e76-9a64-6bc41f49230b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f756b9bd-7c78-4334-b8bb-4e77633daeb4 req-9fd61480-e117-4e76-9a64-6bc41f49230b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f756b9bd-7c78-4334-b8bb-4e77633daeb4 req-9fd61480-e117-4e76-9a64-6bc41f49230b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f756b9bd-7c78-4334-b8bb-4e77633daeb4 req-9fd61480-e117-4e76-9a64-6bc41f49230b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f756b9bd-7c78-4334-b8bb-4e77633daeb4 req-9fd61480-e117-4e76-9a64-6bc41f49230b service nova] Creating event network-changed:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:28:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f756b9bd-7c78-4334-b8bb-4e77633daeb4 req-9fd61480-e117-4e76-9a64-6bc41f49230b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030710 Apr 14 03:28:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 352/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:28:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:14 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-5ef7a3cf-f1fa-4111-b32f-ad16024f0d99 req-4cb4a403-78d7-49fe-99a4-d52b417c9b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "name": "network-vif-plugged", "status": "completed", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5ef7a3cf-f1fa-4111-b32f-ad16024f0d99 req-4cb4a403-78d7-49fe-99a4-d52b417c9b2a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5ef7a3cf-f1fa-4111-b32f-ad16024f0d99 req-4cb4a403-78d7-49fe-99a4-d52b417c9b2a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:14 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5ef7a3cf-f1fa-4111-b32f-ad16024f0d99 req-4cb4a403-78d7-49fe-99a4-d52b417c9b2a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-5ef7a3cf-f1fa-4111-b32f-ad16024f0d99 req-4cb4a403-78d7-49fe-99a4-d52b417c9b2a service nova] Creating event network-vif-plugged:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:28:14 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-5ef7a3cf-f1fa-4111-b32f-ad16024f0d99 req-4cb4a403-78d7-49fe-99a4-d52b417c9b2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030358 Apr 14 03:28:14 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 351/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:28:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=12 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:28:25 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:28:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-102d3249-e877-4239-bd64-4743a2eba22f tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 200 len: 1651 microversion: 2.20 time: 0.161992 Apr 14 03:28:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 353/1056] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:28:25 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 1651 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:28:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c27e0722-71e9-4119-8ed3-950892ed1b31 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:28:27 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c27e0722-71e9-4119-8ed3-950892ed1b31 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:28:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c27e0722-71e9-4119-8ed3-950892ed1b31 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c27e0722-71e9-4119-8ed3-950892ed1b31 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c27e0722-71e9-4119-8ed3-950892ed1b31 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c27e0722-71e9-4119-8ed3-950892ed1b31 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c27e0722-71e9-4119-8ed3-950892ed1b31 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c27e0722-71e9-4119-8ed3-950892ed1b31 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c27e0722-71e9-4119-8ed3-950892ed1b31 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.189781 Apr 14 03:28:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 353/1057] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:28:26 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments => generated 25 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:27 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] HTTP exception thrown: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f is not attached to volume 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Request method failure captured: Apr 14 03:28:27 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments/5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f HTTP/1.1 Apr 14 03:28:27 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:28:27 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:28:27 user devstack@n-api.service[61662]: Connection: close Apr 14 03:28:27 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:28:27 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:28:27 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:28:27 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:28:27 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMXR-kr9xncbKooOUYTDDwxQf6qU6zMY9yLTZpzwPQK4qB9Nshrwjk8wTlNW5n1Cs6HzH56l9wS6C0lQTUfYT459LjMwBhWh4a7viw-lRuTulzvveTDpEpmb9Xa7HRG6FX0dG1VUx4IOd2Th1Q9G3-Qb76Jcva2Oq8xgy-1pHf9G3cI Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Project-Id: 0bd451b3f6734fe3ac0a8e8a853bb9eb Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Project-Name: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}] Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Tenant: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Tenant-Id: 0bd451b3f6734fe3ac0a8e8a853bb9eb Apr 14 03:28:27 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:28:27 user devstack@n-api.service[61662]: X-User: tempest-TestMinimumBasicScenario-144187586-project-member Apr 14 03:28:27 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:28:27 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:28:27 user devstack@n-api.service[61662]: X-User-Id: 12199a43298942898a2e694ee2c5230e Apr 14 03:28:27 user devstack@n-api.service[61662]: X-User-Name: tempest-TestMinimumBasicScenario-144187586-project-member Apr 14 03:28:27 user devstack@n-api.service[61662]: method: > Apr 14 03:28:27 user devstack@n-api.service[61662]: exception: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f is not attached to volume 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f Apr 14 03:28:27 user devstack@n-api.service[61662]: action_args: {'server_id': 'f8042c4c-0ff6-4533-8f59-de5c41ede33f', 'id': '5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f'} Apr 14 03:28:27 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f. Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f is not attached to volume 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f is not attached to volume 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f Apr 14 03:28:27 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:28:27 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Returning 404 to user: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f is not attached to volume 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:28:27 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-10c1aa3c-dc9b-4716-8ff8-10791da29678 tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments/5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f" status: 404 len: 154 microversion: 2.1 time: 0.103803 Apr 14 03:28:27 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 352/1058] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:28:27 2023] DELETE /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f/os-volume_attachments/5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:28:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a7e9aa8b-0e50-4521-a8fe-0b5fa825593d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:28:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a7e9aa8b-0e50-4521-a8fe-0b5fa825593d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:28:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a7e9aa8b-0e50-4521-a8fe-0b5fa825593d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a7e9aa8b-0e50-4521-a8fe-0b5fa825593d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a7e9aa8b-0e50-4521-a8fe-0b5fa825593d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a7e9aa8b-0e50-4521-a8fe-0b5fa825593d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a7e9aa8b-0e50-4521-a8fe-0b5fa825593d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a7e9aa8b-0e50-4521-a8fe-0b5fa825593d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a7e9aa8b-0e50-4521-a8fe-0b5fa825593d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:28:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a7e9aa8b-0e50-4521-a8fe-0b5fa825593d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 204 len: 0 microversion: 2.1 time: 0.176042 Apr 14 03:28:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 354/1059] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:28:32 2023] DELETE /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:28:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c917dd82-68c4-4b5c-8464-f73b684ca68d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:28:32 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c917dd82-68c4-4b5c-8464-f73b684ca68d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:28:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c917dd82-68c4-4b5c-8464-f73b684ca68d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c917dd82-68c4-4b5c-8464-f73b684ca68d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c917dd82-68c4-4b5c-8464-f73b684ca68d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c917dd82-68c4-4b5c-8464-f73b684ca68d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c917dd82-68c4-4b5c-8464-f73b684ca68d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c917dd82-68c4-4b5c-8464-f73b684ca68d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:33 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-c917dd82-68c4-4b5c-8464-f73b684ca68d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12199a43298942898a2e694ee2c5230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd451b3f6734fe3ac0a8e8a853bb9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:28:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c917dd82-68c4-4b5c-8464-f73b684ca68d tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 200 len: 1541 microversion: 2.1 time: 0.328061 Apr 14 03:28:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 354/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:28:32 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 1541 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:28:33 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-4f2eb046-56e8-4775-bcad-1946f0c3d3af req-3971b59b-072d-4d31-9546-d5b37449ddd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "name": "network-vif-unplugged", "status": "completed", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-4f2eb046-56e8-4775-bcad-1946f0c3d3af req-3971b59b-072d-4d31-9546-d5b37449ddd5 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-4f2eb046-56e8-4775-bcad-1946f0c3d3af req-3971b59b-072d-4d31-9546-d5b37449ddd5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-4f2eb046-56e8-4775-bcad-1946f0c3d3af req-3971b59b-072d-4d31-9546-d5b37449ddd5 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:33 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-4f2eb046-56e8-4775-bcad-1946f0c3d3af req-3971b59b-072d-4d31-9546-d5b37449ddd5 service nova] Creating event network-vif-unplugged:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:28:33 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-4f2eb046-56e8-4775-bcad-1946f0c3d3af req-3971b59b-072d-4d31-9546-d5b37449ddd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041311 Apr 14 03:28:33 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 353/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:28:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d4d30d42-cafb-49a7-889f-4891d3b93e22 req-518fa8a8-0292-4132-8cf9-77a61e96a948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "name": "network-vif-deleted", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d4d30d42-cafb-49a7-889f-4891d3b93e22 req-518fa8a8-0292-4132-8cf9-77a61e96a948 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d4d30d42-cafb-49a7-889f-4891d3b93e22 req-518fa8a8-0292-4132-8cf9-77a61e96a948 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d4d30d42-cafb-49a7-889f-4891d3b93e22 req-518fa8a8-0292-4132-8cf9-77a61e96a948 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d4d30d42-cafb-49a7-889f-4891d3b93e22 req-518fa8a8-0292-4132-8cf9-77a61e96a948 service nova] Creating event network-vif-deleted:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:28:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d4d30d42-cafb-49a7-889f-4891d3b93e22 req-518fa8a8-0292-4132-8cf9-77a61e96a948 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037749 Apr 14 03:28:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 355/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:28:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-401d1f6a-de3f-42a0-b3e1-5d672c91d950 req-e48f24b8-8a45-495c-a7cf-dc4450c9b0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8042c4c-0ff6-4533-8f59-de5c41ede33f", "name": "network-vif-plugged", "status": "completed", "tag": "8a4c167f-3166-4f90-91c9-1a1d5be3c92d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-401d1f6a-de3f-42a0-b3e1-5d672c91d950 req-e48f24b8-8a45-495c-a7cf-dc4450c9b0e8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-401d1f6a-de3f-42a0-b3e1-5d672c91d950 req-e48f24b8-8a45-495c-a7cf-dc4450c9b0e8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-401d1f6a-de3f-42a0-b3e1-5d672c91d950 req-e48f24b8-8a45-495c-a7cf-dc4450c9b0e8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-401d1f6a-de3f-42a0-b3e1-5d672c91d950 req-e48f24b8-8a45-495c-a7cf-dc4450c9b0e8 service nova] Creating event network-vif-plugged:8a4c167f-3166-4f90-91c9-1a1d5be3c92d for instance f8042c4c-0ff6-4533-8f59-de5c41ede33f on user Apr 14 03:28:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-401d1f6a-de3f-42a0-b3e1-5d672c91d950 req-e48f24b8-8a45-495c-a7cf-dc4450c9b0e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033671 Apr 14 03:28:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 355/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:28:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:39 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:28:39 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:28:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:39 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:28:39 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:28:39 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4 HTTP/1.1 Apr 14 03:28:39 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:28:39 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:28:39 user devstack@n-api.service[61662]: Connection: close Apr 14 03:28:39 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:28:39 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:28:39 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:28:39 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:28:39 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:28:39 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:28:39 user devstack@n-api.service[61662]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:28:39 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:28:39 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:28:39 user devstack@n-api.service[61662]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:28:39 user devstack@n-api.service[61662]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:28:39 user devstack@n-api.service[61662]: method: > Apr 14 03:28:39 user devstack@n-api.service[61662]: exception: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:28:39 user devstack@n-api.service[61662]: action_args: {'id': '82dc7444-2886-4be4-b565-99e1cb0a70e4'} Apr 14 03:28:39 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:28:39 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:28:39 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:28:39 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f05c2d9c-230a-46ed-95ac-9f3e76c399e2 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4" status: 404 len: 111 microversion: 2.1 time: 0.033244 Apr 14 03:28:39 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 354/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:28:39 2023] GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:28:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ee63f2e1-b172-4b77-8053-1f4ed41794d7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '.version_select at 0x7ff11a2edd80>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:28:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ee63f2e1-b172-4b77-8053-1f4ed41794d7 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-78190679" status: 202 len: 0 microversion: 2.1 time: 0.029654 Apr 14 03:28:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 356/1065] 10.0.0.210 () {62 vars in 1292 bytes} [Fri Apr 14 03:28:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-78190679 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:28:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f0e44e94-f9a9-4315-9066-cd3701cbd268 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: .version_select at 0x7ff11a609cf0>, body: {"keypair": {"name": "tempest-keypair-593638331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+zxZZ5GMAcUkiDF/IM7NIX6IijptgrPizAuOU/j3R7zyDZnX1nJ/MDmrrh8943MffhteeJQmerIBtPnXsmcrCsXT4bq4THSz5cImqnpGKxesbrIxKwITwwkD9M1xlRgQ=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:40 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-f0e44e94-f9a9-4315-9066-cd3701cbd268 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for project 3b689b65111045168cf21c51bf1274f2. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:28:40 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-f0e44e94-f9a9-4315-9066-cd3701cbd268 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for user c1390cde350341c3ac0275e429146cf8 and project 3b689b65111045168cf21c51bf1274f2. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:28:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f0e44e94-f9a9-4315-9066-cd3701cbd268 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047006 Apr 14 03:28:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 356/1066] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 03:28:40 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:41 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-615458774", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c6419e57-87af-44c1-a594-3a6a40f976b8"}], "security_groups": [{"name": "tempest-securitygroup--1866356538"}], "key_name": "tempest-keypair-593638331", "user_data": "}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:42 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] validate_networks() for [('c6419e57-87af-44c1-a594-3a6a40f976b8', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for project 3b689b65111045168cf21c51bf1274f2. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Getting quotas for user c1390cde350341c3ac0275e429146cf8 and project 3b689b65111045168cf21c51bf1274f2. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:28:43 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:28:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3a59ecd7-3c28-44fa-9aec-70ab6cad52a1 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.292906 Apr 14 03:28:43 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 355/1067] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:28:41 2023] POST /compute/v2.1/servers => generated 400 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:28:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4dd7e09a-c5f2-4691-beb8-051b5cbcc71d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:28:43 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4dd7e09a-c5f2-4691-beb8-051b5cbcc71d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:28:43 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4dd7e09a-c5f2-4691-beb8-051b5cbcc71d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:28:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4dd7e09a-c5f2-4691-beb8-051b5cbcc71d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749" status: 200 len: 1234 microversion: 2.1 time: 0.066244 Apr 14 03:28:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 357/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:28:43 2023] GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749 => generated 1234 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:28:45 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=14 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-cfed2fa9-9f6c-4beb-955d-8177ba18b142 req-06ab7cd3-1641-4173-adf2-34817224e49e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ed08b8-18ef-4061-a0e9-9c7f18336749", "tag": "a022509f-61ed-4733-8c46-681c8404e205"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cfed2fa9-9f6c-4beb-955d-8177ba18b142 req-06ab7cd3-1641-4173-adf2-34817224e49e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cfed2fa9-9f6c-4beb-955d-8177ba18b142 req-06ab7cd3-1641-4173-adf2-34817224e49e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cfed2fa9-9f6c-4beb-955d-8177ba18b142 req-06ab7cd3-1641-4173-adf2-34817224e49e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-cfed2fa9-9f6c-4beb-955d-8177ba18b142 req-06ab7cd3-1641-4173-adf2-34817224e49e service nova] Creating event network-changed:a022509f-61ed-4733-8c46-681c8404e205 for instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 on user Apr 14 03:28:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-cfed2fa9-9f6c-4beb-955d-8177ba18b142 req-06ab7cd3-1641-4173-adf2-34817224e49e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031633 Apr 14 03:28:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 357/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:47 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-507346d5-bc1f-418b-ad0f-6c8238c613bd req-c97bbebd-771f-4eac-94d8-e1fd2328d183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ed08b8-18ef-4061-a0e9-9c7f18336749", "name": "network-vif-plugged", "status": "completed", "tag": "a022509f-61ed-4733-8c46-681c8404e205"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-507346d5-bc1f-418b-ad0f-6c8238c613bd req-c97bbebd-771f-4eac-94d8-e1fd2328d183 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-507346d5-bc1f-418b-ad0f-6c8238c613bd req-c97bbebd-771f-4eac-94d8-e1fd2328d183 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-507346d5-bc1f-418b-ad0f-6c8238c613bd req-c97bbebd-771f-4eac-94d8-e1fd2328d183 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:47 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-507346d5-bc1f-418b-ad0f-6c8238c613bd req-c97bbebd-771f-4eac-94d8-e1fd2328d183 service nova] Creating event network-vif-plugged:a022509f-61ed-4733-8c46-681c8404e205 for instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 on user Apr 14 03:28:47 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-507346d5-bc1f-418b-ad0f-6c8238c613bd req-c97bbebd-771f-4eac-94d8-e1fd2328d183 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035780 Apr 14 03:28:47 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 356/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:28:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:28:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ec677fcd-356a-4cf8-a4c3-634ed164fbf2 req-ea714c53-7e34-450f-aab7-15cbb582db6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ed08b8-18ef-4061-a0e9-9c7f18336749", "name": "network-vif-plugged", "status": "completed", "tag": "a022509f-61ed-4733-8c46-681c8404e205"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:28:49 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ec677fcd-356a-4cf8-a4c3-634ed164fbf2 req-ea714c53-7e34-450f-aab7-15cbb582db6c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:28:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ec677fcd-356a-4cf8-a4c3-634ed164fbf2 req-ea714c53-7e34-450f-aab7-15cbb582db6c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:28:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ec677fcd-356a-4cf8-a4c3-634ed164fbf2 req-ea714c53-7e34-450f-aab7-15cbb582db6c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:28:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ec677fcd-356a-4cf8-a4c3-634ed164fbf2 req-ea714c53-7e34-450f-aab7-15cbb582db6c service nova] Creating event network-vif-plugged:a022509f-61ed-4733-8c46-681c8404e205 for instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 on user Apr 14 03:28:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ec677fcd-356a-4cf8-a4c3-634ed164fbf2 req-ea714c53-7e34-450f-aab7-15cbb582db6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034897 Apr 14 03:28:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 358/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:28:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6c512597-dac8-46c2-aac3-84709e4ea655 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6c512597-dac8-46c2-aac3-84709e4ea655 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c512597-dac8-46c2-aac3-84709e4ea655 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c512597-dac8-46c2-aac3-84709e4ea655 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c512597-dac8-46c2-aac3-84709e4ea655 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c512597-dac8-46c2-aac3-84709e4ea655 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c512597-dac8-46c2-aac3-84709e4ea655 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c512597-dac8-46c2-aac3-84709e4ea655 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:03 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-6c512597-dac8-46c2-aac3-84709e4ea655 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f477304a044148ade1c6acffd30712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0979cf1834435bb0007899da52e863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:29:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6c512597-dac8-46c2-aac3-84709e4ea655 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0" status: 200 len: 1499 microversion: 2.1 time: 0.153318 Apr 14 03:29:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 358/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:29:03 2023] GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 => generated 1499 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=14 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] [instance: f8042c4c-0ff6-4533-8f59-de5c41ede33f] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:23 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] HTTP exception thrown: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f could not be found. Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Request method failure captured: Apr 14 03:29:23 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f HTTP/1.1 Apr 14 03:29:23 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:29:23 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:29:23 user devstack@n-api.service[61662]: Connection: close Apr 14 03:29:23 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:29:23 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:29:23 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:29:23 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:29:23 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMXR-kr9xncbKooOUYTDDwxQf6qU6zMY9yLTZpzwPQK4qB9Nshrwjk8wTlNW5n1Cs6HzH56l9wS6C0lQTUfYT459LjMwBhWh4a7viw-lRuTulzvveTDpEpmb9Xa7HRG6FX0dG1VUx4IOd2Th1Q9G3-Qb76Jcva2Oq8xgy-1pHf9G3cI Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Project-Id: 0bd451b3f6734fe3ac0a8e8a853bb9eb Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Project-Name: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0bd451b3f6734fe3ac0a8e8a853bb9eb"}]}] Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Tenant: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Tenant-Id: 0bd451b3f6734fe3ac0a8e8a853bb9eb Apr 14 03:29:23 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-TestMinimumBasicScenario-144187586 Apr 14 03:29:23 user devstack@n-api.service[61662]: X-User: tempest-TestMinimumBasicScenario-144187586-project-member Apr 14 03:29:23 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:29:23 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:29:23 user devstack@n-api.service[61662]: X-User-Id: 12199a43298942898a2e694ee2c5230e Apr 14 03:29:23 user devstack@n-api.service[61662]: X-User-Name: tempest-TestMinimumBasicScenario-144187586-project-member Apr 14 03:29:23 user devstack@n-api.service[61662]: method: > Apr 14 03:29:23 user devstack@n-api.service[61662]: exception: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f could not be found. Apr 14 03:29:23 user devstack@n-api.service[61662]: action_args: {'id': 'f8042c4c-0ff6-4533-8f59-de5c41ede33f'} Apr 14 03:29:23 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f could not be found. Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f could not be found. Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f could not be found. Apr 14 03:29:23 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:29:23 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Returning 404 to user: Instance f8042c4c-0ff6-4533-8f59-de5c41ede33f could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:29:23 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-eb5128bd-adf9-40bf-bdc0-17a8dbcc881b tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f" status: 404 len: 111 microversion: 2.1 time: 0.041115 Apr 14 03:29:23 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 357/1073] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:29:23 2023] GET /compute/v2.1/servers/f8042c4c-0ff6-4533-8f59-de5c41ede33f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:29:23 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:23 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:23 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:23 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-46d3c24f-213f-4924-94e4-9e16afa475fa tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] Calling method '.version_select at 0x7ff11a2ef130>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:29:23 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-46d3c24f-213f-4924-94e4-9e16afa475fa tempest-TestMinimumBasicScenario-144187586 tempest-TestMinimumBasicScenario-144187586-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-35983132" status: 202 len: 0 microversion: 2.1 time: 0.031471 Apr 14 03:29:23 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 359/1074] 10.0.0.210 () {62 vars in 1343 bytes} [Fri Apr 14 03:29:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-35983132 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:29:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6511450c-aabc-4108-ad61-415108622c70 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "206ed030-e355-423f-a35a-3598ef189cce"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:29:25 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6511450c-aabc-4108-ad61-415108622c70 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:29:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6511450c-aabc-4108-ad61-415108622c70 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6511450c-aabc-4108-ad61-415108622c70 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6511450c-aabc-4108-ad61-415108622c70 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6511450c-aabc-4108-ad61-415108622c70 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6511450c-aabc-4108-ad61-415108622c70 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6511450c-aabc-4108-ad61-415108622c70 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6511450c-aabc-4108-ad61-415108622c70 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.344019 Apr 14 03:29:25 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 359/1075] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 03:29:25 2023] POST /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-volume_attachments => generated 188 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:29:25 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-82abefc7-c9d8-4565-85f6-f54cce5db684 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:29:25 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-82abefc7-c9d8-4565-85f6-f54cce5db684 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:29:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-82abefc7-c9d8-4565-85f6-f54cce5db684 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-82abefc7-c9d8-4565-85f6-f54cce5db684 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-82abefc7-c9d8-4565-85f6-f54cce5db684 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-82abefc7-c9d8-4565-85f6-f54cce5db684 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-82abefc7-c9d8-4565-85f6-f54cce5db684 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:25 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-82abefc7-c9d8-4565-85f6-f54cce5db684 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:25 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-82abefc7-c9d8-4565-85f6-f54cce5db684 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61662) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 03:29:26 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-82abefc7-c9d8-4565-85f6-f54cce5db684 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/action" status: 202 len: 0 microversion: 2.20 time: 0.118656 Apr 14 03:29:26 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 358/1076] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 03:29:25 2023] POST /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:29:26 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:29:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-80c9bb53-86b4-4cec-9bb8-a85feadc1b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 200 len: 1737 microversion: 2.20 time: 0.146217 Apr 14 03:29:26 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 360/1077] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:29:26 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:29:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-555fd176-2ad5-49ee-b06d-bede33bb51f1 req-45ccf5d4-5c7c-44e9-aa00-15a04d28092c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:29:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-555fd176-2ad5-49ee-b06d-bede33bb51f1 req-45ccf5d4-5c7c-44e9-aa00-15a04d28092c service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-555fd176-2ad5-49ee-b06d-bede33bb51f1 req-45ccf5d4-5c7c-44e9-aa00-15a04d28092c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-555fd176-2ad5-49ee-b06d-bede33bb51f1 req-45ccf5d4-5c7c-44e9-aa00-15a04d28092c service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-555fd176-2ad5-49ee-b06d-bede33bb51f1 req-45ccf5d4-5c7c-44e9-aa00-15a04d28092c service nova] Creating event network-changed:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:29:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-555fd176-2ad5-49ee-b06d-bede33bb51f1 req-45ccf5d4-5c7c-44e9-aa00-15a04d28092c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071957 Apr 14 03:29:32 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 360/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:29:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 03:29:33 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-8bbe1c26-6ad0-48bf-8276-35db4a257acf tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:29:33 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-8bbe1c26-6ad0-48bf-8276-35db4a257acf tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:29:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bbe1c26-6ad0-48bf-8276-35db4a257acf tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bbe1c26-6ad0-48bf-8276-35db4a257acf tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bbe1c26-6ad0-48bf-8276-35db4a257acf tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bbe1c26-6ad0-48bf-8276-35db4a257acf tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bbe1c26-6ad0-48bf-8276-35db4a257acf tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:33 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-8bbe1c26-6ad0-48bf-8276-35db4a257acf tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:34 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-8bbe1c26-6ad0-48bf-8276-35db4a257acf tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:29:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-8bbe1c26-6ad0-48bf-8276-35db4a257acf tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749" status: 200 len: 1544 microversion: 2.1 time: 0.670921 Apr 14 03:29:34 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 359/1079] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:29:33 2023] GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749 => generated 1544 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:29:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-cec9eed9-a8fc-453e-ac74-6298fa062596 req-c44f8dc0-0a3f-4ce6-afbd-f11ffdd0912b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "name": "network-vif-plugged", "status": "completed", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:29:41 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:41 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cec9eed9-a8fc-453e-ac74-6298fa062596 req-c44f8dc0-0a3f-4ce6-afbd-f11ffdd0912b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cec9eed9-a8fc-453e-ac74-6298fa062596 req-c44f8dc0-0a3f-4ce6-afbd-f11ffdd0912b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cec9eed9-a8fc-453e-ac74-6298fa062596 req-c44f8dc0-0a3f-4ce6-afbd-f11ffdd0912b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-cec9eed9-a8fc-453e-ac74-6298fa062596 req-c44f8dc0-0a3f-4ce6-afbd-f11ffdd0912b service nova] Creating event network-vif-plugged:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:29:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-cec9eed9-a8fc-453e-ac74-6298fa062596 req-c44f8dc0-0a3f-4ce6-afbd-f11ffdd0912b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049827 Apr 14 03:29:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 361/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:29:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:29:43 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:43 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d1e62d02-7705-4a9b-94c4-41160bfa0e81 req-30ad7c50-56ab-4b1c-8719-1f4b1033be82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "name": "network-vif-plugged", "status": "completed", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:29:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d1e62d02-7705-4a9b-94c4-41160bfa0e81 req-30ad7c50-56ab-4b1c-8719-1f4b1033be82 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:29:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d1e62d02-7705-4a9b-94c4-41160bfa0e81 req-30ad7c50-56ab-4b1c-8719-1f4b1033be82 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:29:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d1e62d02-7705-4a9b-94c4-41160bfa0e81 req-30ad7c50-56ab-4b1c-8719-1f4b1033be82 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:29:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d1e62d02-7705-4a9b-94c4-41160bfa0e81 req-30ad7c50-56ab-4b1c-8719-1f4b1033be82 service nova] Creating event network-vif-plugged:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:29:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d1e62d02-7705-4a9b-94c4-41160bfa0e81 req-30ad7c50-56ab-4b1c-8719-1f4b1033be82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052455 Apr 14 03:29:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 361/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:29:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-e491ff9a-a99a-4cc6-a075-e129c39966e3 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-e491ff9a-a99a-4cc6-a075-e129c39966e3 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e491ff9a-a99a-4cc6-a075-e129c39966e3 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e491ff9a-a99a-4cc6-a075-e129c39966e3 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e491ff9a-a99a-4cc6-a075-e129c39966e3 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e491ff9a-a99a-4cc6-a075-e129c39966e3 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e491ff9a-a99a-4cc6-a075-e129c39966e3 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-e491ff9a-a99a-4cc6-a075-e129c39966e3 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:03 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-e491ff9a-a99a-4cc6-a075-e129c39966e3 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61662) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 03:30:03 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-e491ff9a-a99a-4cc6-a075-e129c39966e3 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0/action" status: 202 len: 0 microversion: 2.1 time: 0.115710 Apr 14 03:30:03 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 360/1082] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 03:30:03 2023] POST /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c7171280-6cb0-4c7e-8026-05c3e6346c1f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c7171280-6cb0-4c7e-8026-05c3e6346c1f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7171280-6cb0-4c7e-8026-05c3e6346c1f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7171280-6cb0-4c7e-8026-05c3e6346c1f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7171280-6cb0-4c7e-8026-05c3e6346c1f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7171280-6cb0-4c7e-8026-05c3e6346c1f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7171280-6cb0-4c7e-8026-05c3e6346c1f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7171280-6cb0-4c7e-8026-05c3e6346c1f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:03 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c7171280-6cb0-4c7e-8026-05c3e6346c1f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f477304a044148ade1c6acffd30712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0979cf1834435bb0007899da52e863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:30:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c7171280-6cb0-4c7e-8026-05c3e6346c1f tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0" status: 200 len: 1507 microversion: 2.1 time: 0.267344 Apr 14 03:30:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 362/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:30:03 2023] GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:30:10 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:10 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:10 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-34a36785-944b-4eb6-b8e6-8e8f913265eb req-0d9dba25-dd87-43f6-a48e-0bfd12d0a077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:30:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-34a36785-944b-4eb6-b8e6-8e8f913265eb req-0d9dba25-dd87-43f6-a48e-0bfd12d0a077 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-34a36785-944b-4eb6-b8e6-8e8f913265eb req-0d9dba25-dd87-43f6-a48e-0bfd12d0a077 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-34a36785-944b-4eb6-b8e6-8e8f913265eb req-0d9dba25-dd87-43f6-a48e-0bfd12d0a077 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-34a36785-944b-4eb6-b8e6-8e8f913265eb req-0d9dba25-dd87-43f6-a48e-0bfd12d0a077 service nova] Creating event network-changed:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:30:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-34a36785-944b-4eb6-b8e6-8e8f913265eb req-0d9dba25-dd87-43f6-a48e-0bfd12d0a077 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034366 Apr 14 03:30:10 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 362/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:30:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:30:13 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:13 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:13 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-18a58f14-0f32-468c-a468-4d5463b23d7f req-379651df-1b83-4125-a42e-df100d899a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "name": "network-vif-plugged", "status": "completed", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:30:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-18a58f14-0f32-468c-a468-4d5463b23d7f req-379651df-1b83-4125-a42e-df100d899a6b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-18a58f14-0f32-468c-a468-4d5463b23d7f req-379651df-1b83-4125-a42e-df100d899a6b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:13 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-18a58f14-0f32-468c-a468-4d5463b23d7f req-379651df-1b83-4125-a42e-df100d899a6b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:13 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-18a58f14-0f32-468c-a468-4d5463b23d7f req-379651df-1b83-4125-a42e-df100d899a6b service nova] Creating event network-vif-plugged:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:30:13 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-18a58f14-0f32-468c-a468-4d5463b23d7f req-379651df-1b83-4125-a42e-df100d899a6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159055 Apr 14 03:30:13 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 361/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:30:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:30:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-b59d3c8b-d071-4bc8-b04f-793f985d47cd req-4031a682-e897-4b90-933d-8550323790bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "name": "network-vif-plugged", "status": "completed", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:30:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b59d3c8b-d071-4bc8-b04f-793f985d47cd req-4031a682-e897-4b90-933d-8550323790bb service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b59d3c8b-d071-4bc8-b04f-793f985d47cd req-4031a682-e897-4b90-933d-8550323790bb service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b59d3c8b-d071-4bc8-b04f-793f985d47cd req-4031a682-e897-4b90-933d-8550323790bb service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-b59d3c8b-d071-4bc8-b04f-793f985d47cd req-4031a682-e897-4b90-933d-8550323790bb service nova] Creating event network-vif-plugged:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:30:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-b59d3c8b-d071-4bc8-b04f-793f985d47cd req-4031a682-e897-4b90-933d-8550323790bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033560 Apr 14 03:30:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 363/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:30:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:30:16 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:30:16 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-16b27b7b-7178-4009-9de0-4d1894b115c0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 200 len: 1782 microversion: 2.20 time: 0.279599 Apr 14 03:30:16 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 363/1087] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:30:16 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 1782 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:30:34 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:34 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:34 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d38c07af-f594-4ede-8149-28a31621227c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:30:34 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d38c07af-f594-4ede-8149-28a31621227c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:30:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d38c07af-f594-4ede-8149-28a31621227c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d38c07af-f594-4ede-8149-28a31621227c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d38c07af-f594-4ede-8149-28a31621227c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d38c07af-f594-4ede-8149-28a31621227c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d38c07af-f594-4ede-8149-28a31621227c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d38c07af-f594-4ede-8149-28a31621227c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d38c07af-f594-4ede-8149-28a31621227c tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.110626 Apr 14 03:30:34 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 362/1088] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 03:30:34 2023] GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/os-interface => generated 282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:30:35 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:35 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-5af207fc-e670-4b02-99ca-f76cd9323052 req-a964c39d-7e65-4f5e-8185-55f6ad90a5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ed08b8-18ef-4061-a0e9-9c7f18336749", "tag": "a022509f-61ed-4733-8c46-681c8404e205"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:30:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5af207fc-e670-4b02-99ca-f76cd9323052 req-a964c39d-7e65-4f5e-8185-55f6ad90a5c6 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5af207fc-e670-4b02-99ca-f76cd9323052 req-a964c39d-7e65-4f5e-8185-55f6ad90a5c6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5af207fc-e670-4b02-99ca-f76cd9323052 req-a964c39d-7e65-4f5e-8185-55f6ad90a5c6 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5af207fc-e670-4b02-99ca-f76cd9323052 req-a964c39d-7e65-4f5e-8185-55f6ad90a5c6 service nova] Creating event network-changed:a022509f-61ed-4733-8c46-681c8404e205 for instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 on user Apr 14 03:30:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-5af207fc-e670-4b02-99ca-f76cd9323052 req-a964c39d-7e65-4f5e-8185-55f6ad90a5c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035363 Apr 14 03:30:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 364/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:30:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:30:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1e2f87e2-5a7c-4ca7-8acd-7866bbf55341 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:30:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1e2f87e2-5a7c-4ca7-8acd-7866bbf55341 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:30:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e2f87e2-5a7c-4ca7-8acd-7866bbf55341 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e2f87e2-5a7c-4ca7-8acd-7866bbf55341 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e2f87e2-5a7c-4ca7-8acd-7866bbf55341 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e2f87e2-5a7c-4ca7-8acd-7866bbf55341 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e2f87e2-5a7c-4ca7-8acd-7866bbf55341 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e2f87e2-5a7c-4ca7-8acd-7866bbf55341 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1e2f87e2-5a7c-4ca7-8acd-7866bbf55341 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/ips" status: 200 len: 148 microversion: 2.1 time: 0.042612 Apr 14 03:30:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 364/1090] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 03:30:36 2023] GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:30:37 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-dd443342-9a5a-4bb4-b79c-d7014439b281 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52935d67-1254-4ae3-810b-7b1ffa098955"}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:30:37 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-dd443342-9a5a-4bb4-b79c-d7014439b281 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:30:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dd443342-9a5a-4bb4-b79c-d7014439b281 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dd443342-9a5a-4bb4-b79c-d7014439b281 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dd443342-9a5a-4bb4-b79c-d7014439b281 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dd443342-9a5a-4bb4-b79c-d7014439b281 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dd443342-9a5a-4bb4-b79c-d7014439b281 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:37 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-dd443342-9a5a-4bb4-b79c-d7014439b281 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:37 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-dd443342-9a5a-4bb4-b79c-d7014439b281 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "POST /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262125 Apr 14 03:30:37 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 363/1091] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 03:30:37 2023] POST /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:30:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-54d6d9e9-cd19-4390-9707-985a9c5dac9b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:30:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-54d6d9e9-cd19-4390-9707-985a9c5dac9b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:30:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-54d6d9e9-cd19-4390-9707-985a9c5dac9b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-54d6d9e9-cd19-4390-9707-985a9c5dac9b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-54d6d9e9-cd19-4390-9707-985a9c5dac9b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-54d6d9e9-cd19-4390-9707-985a9c5dac9b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-54d6d9e9-cd19-4390-9707-985a9c5dac9b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-54d6d9e9-cd19-4390-9707-985a9c5dac9b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:44 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-54d6d9e9-cd19-4390-9707-985a9c5dac9b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lazy-loading 'services' on Instance uuid 09ed08b8-18ef-4061-a0e9-9c7f18336749 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:30:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-54d6d9e9-cd19-4390-9707-985a9c5dac9b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/os-volume_attachments/52935d67-1254-4ae3-810b-7b1ffa098955" status: 202 len: 0 microversion: 2.1 time: 0.160815 Apr 14 03:30:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 365/1092] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 03:30:44 2023] DELETE /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/os-volume_attachments/52935d67-1254-4ae3-810b-7b1ffa098955 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:30:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6e718f3d-7cdc-4002-b6a4-040c3694269b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:30:44 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6e718f3d-7cdc-4002-b6a4-040c3694269b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:30:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6e718f3d-7cdc-4002-b6a4-040c3694269b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6e718f3d-7cdc-4002-b6a4-040c3694269b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6e718f3d-7cdc-4002-b6a4-040c3694269b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6e718f3d-7cdc-4002-b6a4-040c3694269b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6e718f3d-7cdc-4002-b6a4-040c3694269b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6e718f3d-7cdc-4002-b6a4-040c3694269b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6e718f3d-7cdc-4002-b6a4-040c3694269b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046487 Apr 14 03:30:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 365/1093] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:30:44 2023] GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c0f80627-a3fa-4c87-9dad-3813361d326e tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c0f80627-a3fa-4c87-9dad-3813361d326e tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c0f80627-a3fa-4c87-9dad-3813361d326e tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c0f80627-a3fa-4c87-9dad-3813361d326e tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c0f80627-a3fa-4c87-9dad-3813361d326e tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c0f80627-a3fa-4c87-9dad-3813361d326e tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c0f80627-a3fa-4c87-9dad-3813361d326e tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c0f80627-a3fa-4c87-9dad-3813361d326e tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:30:53 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-c0f80627-a3fa-4c87-9dad-3813361d326e tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f477304a044148ade1c6acffd30712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0979cf1834435bb0007899da52e863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:30:53 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c0f80627-a3fa-4c87-9dad-3813361d326e tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0" status: 200 len: 1552 microversion: 2.1 time: 0.163606 Apr 14 03:30:53 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 364/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:30:53 2023] GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:31:16 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:16 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ed3a8a58-b44d-489b-8707-869fc40f831e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:31:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ed3a8a58-b44d-489b-8707-869fc40f831e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:31:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a58-b44d-489b-8707-869fc40f831e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a58-b44d-489b-8707-869fc40f831e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a58-b44d-489b-8707-869fc40f831e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a58-b44d-489b-8707-869fc40f831e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a58-b44d-489b-8707-869fc40f831e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed3a8a58-b44d-489b-8707-869fc40f831e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ed3a8a58-b44d-489b-8707-869fc40f831e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-volume_attachments/206ed030-e355-423f-a35a-3598ef189cce" status: 200 len: 194 microversion: 2.20 time: 0.187492 Apr 14 03:31:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 366/1095] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 03:31:16 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-volume_attachments/206ed030-e355-423f-a35a-3598ef189cce => generated 194 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:31:16 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ef0b10a4-005e-4638-bb4d-733bf3741232 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:31:16 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ef0b10a4-005e-4638-bb4d-733bf3741232 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:31:16 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:16 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=10 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef0b10a4-005e-4638-bb4d-733bf3741232 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef0b10a4-005e-4638-bb4d-733bf3741232 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef0b10a4-005e-4638-bb4d-733bf3741232 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef0b10a4-005e-4638-bb4d-733bf3741232 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef0b10a4-005e-4638-bb4d-733bf3741232 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef0b10a4-005e-4638-bb4d-733bf3741232 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:17 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-ef0b10a4-005e-4638-bb4d-733bf3741232 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lazy-loading 'services' on Instance uuid 16e9b236-ce8f-4231-af55-e694bc43dde4 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:31:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ef0b10a4-005e-4638-bb4d-733bf3741232 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-volume_attachments/206ed030-e355-423f-a35a-3598ef189cce" status: 202 len: 0 microversion: 2.20 time: 0.186972 Apr 14 03:31:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 366/1096] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 03:31:16 2023] DELETE /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-volume_attachments/206ed030-e355-423f-a35a-3598ef189cce => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:31:17 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-1ab88a6f-6362-4239-ad67-4ddd5cfb3b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:31:17 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-1ab88a6f-6362-4239-ad67-4ddd5cfb3b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:31:17 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:17 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1ab88a6f-6362-4239-ad67-4ddd5cfb3b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1ab88a6f-6362-4239-ad67-4ddd5cfb3b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1ab88a6f-6362-4239-ad67-4ddd5cfb3b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1ab88a6f-6362-4239-ad67-4ddd5cfb3b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1ab88a6f-6362-4239-ad67-4ddd5cfb3b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:17 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-1ab88a6f-6362-4239-ad67-4ddd5cfb3b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:17 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-1ab88a6f-6362-4239-ad67-4ddd5cfb3b86 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051060 Apr 14 03:31:17 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 365/1097] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 03:31:17 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:31:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1e06609c-674e-43c0-93e6-5c43ac090cb4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:31:34 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1e06609c-674e-43c0-93e6-5c43ac090cb4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:31:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e06609c-674e-43c0-93e6-5c43ac090cb4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e06609c-674e-43c0-93e6-5c43ac090cb4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e06609c-674e-43c0-93e6-5c43ac090cb4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e06609c-674e-43c0-93e6-5c43ac090cb4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e06609c-674e-43c0-93e6-5c43ac090cb4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e06609c-674e-43c0-93e6-5c43ac090cb4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1e06609c-674e-43c0-93e6-5c43ac090cb4 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049999 Apr 14 03:31:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 367/1098] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 03:31:34 2023] GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1fbcc52d-54ca-4a48-ada6-48106feb1cef tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1fbcc52d-54ca-4a48-ada6-48106feb1cef tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1fbcc52d-54ca-4a48-ada6-48106feb1cef tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1fbcc52d-54ca-4a48-ada6-48106feb1cef tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1fbcc52d-54ca-4a48-ada6-48106feb1cef tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1fbcc52d-54ca-4a48-ada6-48106feb1cef tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1fbcc52d-54ca-4a48-ada6-48106feb1cef tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1fbcc52d-54ca-4a48-ada6-48106feb1cef tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:34 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1fbcc52d-54ca-4a48-ada6-48106feb1cef tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:31:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1fbcc52d-54ca-4a48-ada6-48106feb1cef tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749" status: 204 len: 0 microversion: 2.1 time: 0.133757 Apr 14 03:31:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 367/1099] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:31:34 2023] DELETE /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-69bbe1eb-df21-41d6-af82-5d6871895d66 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-69bbe1eb-df21-41d6-af82-5d6871895d66 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-69bbe1eb-df21-41d6-af82-5d6871895d66 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-69bbe1eb-df21-41d6-af82-5d6871895d66 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-69bbe1eb-df21-41d6-af82-5d6871895d66 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-69bbe1eb-df21-41d6-af82-5d6871895d66 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-69bbe1eb-df21-41d6-af82-5d6871895d66 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-69bbe1eb-df21-41d6-af82-5d6871895d66 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:35 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-69bbe1eb-df21-41d6-af82-5d6871895d66 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1390cde350341c3ac0275e429146cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b689b65111045168cf21c51bf1274f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:31:35 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-69bbe1eb-df21-41d6-af82-5d6871895d66 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749" status: 200 len: 1669 microversion: 2.1 time: 0.228589 Apr 14 03:31:35 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 366/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:31:35 2023] GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749 => generated 1669 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:31:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-2caf1dfb-4c87-4454-a994-4834d4b47def req-9b19ae03-5463-4fee-9d4f-83e60bef3f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ed08b8-18ef-4061-a0e9-9c7f18336749", "name": "network-vif-unplugged", "status": "completed", "tag": "a022509f-61ed-4733-8c46-681c8404e205"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:31:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2caf1dfb-4c87-4454-a994-4834d4b47def req-9b19ae03-5463-4fee-9d4f-83e60bef3f66 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2caf1dfb-4c87-4454-a994-4834d4b47def req-9b19ae03-5463-4fee-9d4f-83e60bef3f66 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2caf1dfb-4c87-4454-a994-4834d4b47def req-9b19ae03-5463-4fee-9d4f-83e60bef3f66 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-2caf1dfb-4c87-4454-a994-4834d4b47def req-9b19ae03-5463-4fee-9d4f-83e60bef3f66 service nova] Creating event network-vif-unplugged:a022509f-61ed-4733-8c46-681c8404e205 for instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 on user Apr 14 03:31:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-2caf1dfb-4c87-4454-a994-4834d4b47def req-9b19ae03-5463-4fee-9d4f-83e60bef3f66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084418 Apr 14 03:31:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 368/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:31:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:31:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f1b6acce-9f53-4d61-a717-17c66b07c7f7 req-0ad78997-da36-4fed-a7a1-73e8d6724dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ed08b8-18ef-4061-a0e9-9c7f18336749", "name": "network-vif-plugged", "status": "completed", "tag": "a022509f-61ed-4733-8c46-681c8404e205"}, {"server_uuid": "09ed08b8-18ef-4061-a0e9-9c7f18336749", "name": "network-vif-deleted", "tag": "a022509f-61ed-4733-8c46-681c8404e205"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:31:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f1b6acce-9f53-4d61-a717-17c66b07c7f7 req-0ad78997-da36-4fed-a7a1-73e8d6724dc4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f1b6acce-9f53-4d61-a717-17c66b07c7f7 req-0ad78997-da36-4fed-a7a1-73e8d6724dc4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f1b6acce-9f53-4d61-a717-17c66b07c7f7 req-0ad78997-da36-4fed-a7a1-73e8d6724dc4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f1b6acce-9f53-4d61-a717-17c66b07c7f7 req-0ad78997-da36-4fed-a7a1-73e8d6724dc4 service nova] Creating event network-vif-plugged:a022509f-61ed-4733-8c46-681c8404e205 for instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 on user Apr 14 03:31:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f1b6acce-9f53-4d61-a717-17c66b07c7f7 req-0ad78997-da36-4fed-a7a1-73e8d6724dc4 service nova] Creating event network-vif-deleted:a022509f-61ed-4733-8c46-681c8404e205 for instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 on user Apr 14 03:31:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f1b6acce-9f53-4d61-a717-17c66b07c7f7 req-0ad78997-da36-4fed-a7a1-73e8d6724dc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033248 Apr 14 03:31:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 368/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:31:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:54 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:31:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-35d12e93-c1ed-4b3c-8b4f-9d0406925c7f req-68e85704-f56b-4c12-811a-adb1a5596dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:31:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-35d12e93-c1ed-4b3c-8b4f-9d0406925c7f req-68e85704-f56b-4c12-811a-adb1a5596dc0 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-35d12e93-c1ed-4b3c-8b4f-9d0406925c7f req-68e85704-f56b-4c12-811a-adb1a5596dc0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-35d12e93-c1ed-4b3c-8b4f-9d0406925c7f req-68e85704-f56b-4c12-811a-adb1a5596dc0 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-35d12e93-c1ed-4b3c-8b4f-9d0406925c7f req-68e85704-f56b-4c12-811a-adb1a5596dc0 service nova] Creating event network-changed:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:31:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-35d12e93-c1ed-4b3c-8b4f-9d0406925c7f req-68e85704-f56b-4c12-811a-adb1a5596dc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092136 Apr 14 03:31:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 369/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:31:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:31:54 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0" status: 204 len: 0 microversion: 2.1 time: 0.123342 Apr 14 03:31:54 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 367/1104] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:31:54 2023] DELETE /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:31:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7d89715f-7d6e-4a45-a479-b606523514a5 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:31:54 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7d89715f-7d6e-4a45-a479-b606523514a5 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:31:54 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:54 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7d89715f-7d6e-4a45-a479-b606523514a5 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7d89715f-7d6e-4a45-a479-b606523514a5 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7d89715f-7d6e-4a45-a479-b606523514a5 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7d89715f-7d6e-4a45-a479-b606523514a5 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7d89715f-7d6e-4a45-a479-b606523514a5 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7d89715f-7d6e-4a45-a479-b606523514a5 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:55 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7d89715f-7d6e-4a45-a479-b606523514a5 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f477304a044148ade1c6acffd30712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0979cf1834435bb0007899da52e863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:31:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7d89715f-7d6e-4a45-a479-b606523514a5 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0" status: 200 len: 1558 microversion: 2.1 time: 0.259723 Apr 14 03:31:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 369/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:31:54 2023] GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 => generated 1558 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:31:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-1a030c30-e16b-42d2-abb3-4f8b0bb99a76 req-eb1242ac-b520-42a2-8cb8-a0d15efdd0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "name": "network-vif-unplugged", "status": "completed", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:31:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1a030c30-e16b-42d2-abb3-4f8b0bb99a76 req-eb1242ac-b520-42a2-8cb8-a0d15efdd0aa service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1a030c30-e16b-42d2-abb3-4f8b0bb99a76 req-eb1242ac-b520-42a2-8cb8-a0d15efdd0aa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1a030c30-e16b-42d2-abb3-4f8b0bb99a76 req-eb1242ac-b520-42a2-8cb8-a0d15efdd0aa service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-1a030c30-e16b-42d2-abb3-4f8b0bb99a76 req-eb1242ac-b520-42a2-8cb8-a0d15efdd0aa service nova] Creating event network-vif-unplugged:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:31:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-1a030c30-e16b-42d2-abb3-4f8b0bb99a76 req-eb1242ac-b520-42a2-8cb8-a0d15efdd0aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030704 Apr 14 03:31:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 370/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:31:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-0d3d860b-a37b-4bf2-9d5f-a978ca7464a7 req-f0e9bd79-6e79-4ce2-815e-e098ef5cbb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "name": "network-vif-deleted", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:31:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0d3d860b-a37b-4bf2-9d5f-a978ca7464a7 req-f0e9bd79-6e79-4ce2-815e-e098ef5cbb8e service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0d3d860b-a37b-4bf2-9d5f-a978ca7464a7 req-f0e9bd79-6e79-4ce2-815e-e098ef5cbb8e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-0d3d860b-a37b-4bf2-9d5f-a978ca7464a7 req-f0e9bd79-6e79-4ce2-815e-e098ef5cbb8e service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-0d3d860b-a37b-4bf2-9d5f-a978ca7464a7 req-f0e9bd79-6e79-4ce2-815e-e098ef5cbb8e service nova] Creating event network-vif-deleted:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:31:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-0d3d860b-a37b-4bf2-9d5f-a978ca7464a7 req-f0e9bd79-6e79-4ce2-815e-e098ef5cbb8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031330 Apr 14 03:31:56 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 368/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:31:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:31:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-3222deaf-8f35-46eb-8312-5eab902a9da9 req-0291e4d4-c670-485d-b4c3-19afce650d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce889d46-fac9-4f77-9d66-6e7753d8a0e0", "name": "network-vif-plugged", "status": "completed", "tag": "a0610502-2adf-475c-822c-d96d457872a8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:31:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3222deaf-8f35-46eb-8312-5eab902a9da9 req-0291e4d4-c670-485d-b4c3-19afce650d4d service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:31:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3222deaf-8f35-46eb-8312-5eab902a9da9 req-0291e4d4-c670-485d-b4c3-19afce650d4d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:31:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3222deaf-8f35-46eb-8312-5eab902a9da9 req-0291e4d4-c670-485d-b4c3-19afce650d4d service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:31:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-3222deaf-8f35-46eb-8312-5eab902a9da9 req-0291e4d4-c670-485d-b4c3-19afce650d4d service nova] Creating event network-vif-plugged:a0610502-2adf-475c-822c-d96d457872a8 for instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 on user Apr 14 03:31:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-3222deaf-8f35-46eb-8312-5eab902a9da9 req-0291e4d4-c670-485d-b4c3-19afce650d4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027077 Apr 14 03:31:57 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 370/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:31:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d6081b65-7f12-4c99-9703-d8a9226ee53d tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d6081b65-7f12-4c99-9703-d8a9226ee53d tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d6081b65-7f12-4c99-9703-d8a9226ee53d tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d6081b65-7f12-4c99-9703-d8a9226ee53d tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d6081b65-7f12-4c99-9703-d8a9226ee53d tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d6081b65-7f12-4c99-9703-d8a9226ee53d tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d6081b65-7f12-4c99-9703-d8a9226ee53d tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d6081b65-7f12-4c99-9703-d8a9226ee53d tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d6081b65-7f12-4c99-9703-d8a9226ee53d tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049265 Apr 14 03:32:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 371/1109] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 03:32:07 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d611797d-55b2-468d-afe2-fc981be8f2cb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d611797d-55b2-468d-afe2-fc981be8f2cb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d611797d-55b2-468d-afe2-fc981be8f2cb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d611797d-55b2-468d-afe2-fc981be8f2cb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d611797d-55b2-468d-afe2-fc981be8f2cb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d611797d-55b2-468d-afe2-fc981be8f2cb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d611797d-55b2-468d-afe2-fc981be8f2cb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-d611797d-55b2-468d-afe2-fc981be8f2cb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:07 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-d611797d-55b2-468d-afe2-fc981be8f2cb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:32:07 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d611797d-55b2-468d-afe2-fc981be8f2cb tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 204 len: 0 microversion: 2.20 time: 0.116445 Apr 14 03:32:07 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 369/1110] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:32:07 2023] DELETE /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:32:07 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:32:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-77473be7-1d87-4ddc-bac7-9c5e7fcb5992 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 200 len: 1710 microversion: 2.20 time: 0.199806 Apr 14 03:32:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 371/1111] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:32:07 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 1710 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-8c6119ed-eccc-4b3b-bbf2-e8e6b1956de2 req-24359ab9-a409-48c2-81a9-7d231b476fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "name": "network-vif-unplugged", "status": "completed", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8c6119ed-eccc-4b3b-bbf2-e8e6b1956de2 req-24359ab9-a409-48c2-81a9-7d231b476fd2 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8c6119ed-eccc-4b3b-bbf2-e8e6b1956de2 req-24359ab9-a409-48c2-81a9-7d231b476fd2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8c6119ed-eccc-4b3b-bbf2-e8e6b1956de2 req-24359ab9-a409-48c2-81a9-7d231b476fd2 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-8c6119ed-eccc-4b3b-bbf2-e8e6b1956de2 req-24359ab9-a409-48c2-81a9-7d231b476fd2 service nova] Creating event network-vif-unplugged:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:32:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-8c6119ed-eccc-4b3b-bbf2-e8e6b1956de2 req-24359ab9-a409-48c2-81a9-7d231b476fd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046731 Apr 14 03:32:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 372/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:32:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:32:09 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-571333fa-163d-40c4-9370-6f1acd7f8e22 req-d2bc62f5-74ce-4805-8fa5-c9f11f06dc73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "name": "network-vif-plugged", "status": "completed", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}, {"server_uuid": "16e9b236-ce8f-4231-af55-e694bc43dde4", "name": "network-vif-deleted", "tag": "b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:32:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-571333fa-163d-40c4-9370-6f1acd7f8e22 req-d2bc62f5-74ce-4805-8fa5-c9f11f06dc73 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-571333fa-163d-40c4-9370-6f1acd7f8e22 req-d2bc62f5-74ce-4805-8fa5-c9f11f06dc73 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:09 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-571333fa-163d-40c4-9370-6f1acd7f8e22 req-d2bc62f5-74ce-4805-8fa5-c9f11f06dc73 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:09 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-571333fa-163d-40c4-9370-6f1acd7f8e22 req-d2bc62f5-74ce-4805-8fa5-c9f11f06dc73 service nova] Creating event network-vif-plugged:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:32:09 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-571333fa-163d-40c4-9370-6f1acd7f8e22 req-d2bc62f5-74ce-4805-8fa5-c9f11f06dc73 service nova] Creating event network-vif-deleted:b47d2f30-8e02-4ff3-aae9-4b818e1ab8d4 for instance 16e9b236-ce8f-4231-af55-e694bc43dde4 on user Apr 14 03:32:09 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-571333fa-163d-40c4-9370-6f1acd7f8e22 req-d2bc62f5-74ce-4805-8fa5-c9f11f06dc73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029413 Apr 14 03:32:09 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 370/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:32:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:32:25 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749 HTTP/1.1 Apr 14 03:32:25 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:32:25 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:32:25 user devstack@n-api.service[61664]: Connection: close Apr 14 03:32:25 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:32:25 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:32:25 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:32:25 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:32:25 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:25 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:25 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:25 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:32:25 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:32:25 user devstack@n-api.service[61664]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:32:25 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:25 user devstack@n-api.service[61664]: method: > Apr 14 03:32:25 user devstack@n-api.service[61664]: exception: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:25 user devstack@n-api.service[61664]: action_args: {'id': '09ed08b8-18ef-4061-a0e9-9c7f18336749'} Apr 14 03:32:25 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:25 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a7701667-aecc-4840-85a6-3fe3bc89c0fc tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749" status: 404 len: 111 microversion: 2.1 time: 0.038798 Apr 14 03:32:25 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 372/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:32:25 2023] GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:32:25 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:25 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6375b573-f04a-4de7-81f5-21383817bdae tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '.version_select at 0x7ff11a2ef640>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6375b573-f04a-4de7-81f5-21383817bdae tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-593638331" status: 202 len: 0 microversion: 2.1 time: 0.039607 Apr 14 03:32:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 373/1115] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 03:32:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-593638331 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:32:29 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749 HTTP/1.1 Apr 14 03:32:29 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:32:29 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:32:29 user devstack@n-api.service[61662]: Connection: close Apr 14 03:32:29 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:32:29 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:32:29 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:32:29 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:32:29 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:29 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:29 user devstack@n-api.service[61662]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:29 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:32:29 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:32:29 user devstack@n-api.service[61662]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:32:29 user devstack@n-api.service[61662]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:29 user devstack@n-api.service[61662]: method: > Apr 14 03:32:29 user devstack@n-api.service[61662]: exception: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:29 user devstack@n-api.service[61662]: action_args: {'id': '09ed08b8-18ef-4061-a0e9-9c7f18336749'} Apr 14 03:32:29 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-170d5cec-9c11-4c96-bf5a-e5b5ce3424ad tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749" status: 404 len: 111 microversion: 2.1 time: 0.042674 Apr 14 03:32:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 371/1116] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:32:29 2023] DELETE /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:32:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:29 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 09ed08b8-18ef-4061-a0e9-9c7f18336749] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:32:29 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749 HTTP/1.1 Apr 14 03:32:29 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:32:29 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:32:29 user devstack@n-api.service[61664]: Connection: close Apr 14 03:32:29 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:32:29 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:32:29 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:32:29 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:32:29 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:29 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:29 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:29 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:32:29 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:32:29 user devstack@n-api.service[61664]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:32:29 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:29 user devstack@n-api.service[61664]: method: > Apr 14 03:32:29 user devstack@n-api.service[61664]: exception: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:29 user devstack@n-api.service[61664]: action_args: {'id': '09ed08b8-18ef-4061-a0e9-9c7f18336749'} Apr 14 03:32:29 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. Apr 14 03:32:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 09ed08b8-18ef-4061-a0e9-9c7f18336749 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d6b6b1c6-da0d-44be-bab0-c1717fd71385 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749" status: 404 len: 111 microversion: 2.1 time: 0.032428 Apr 14 03:32:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 373/1117] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:32:29 2023] GET /compute/v2.1/servers/09ed08b8-18ef-4061-a0e9-9c7f18336749 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:32:32 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4 HTTP/1.1 Apr 14 03:32:32 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:32:32 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:32:32 user devstack@n-api.service[61663]: Connection: close Apr 14 03:32:32 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:32:32 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:32:32 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:32:32 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:32:32 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:32 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:32:32 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:32:32 user devstack@n-api.service[61663]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:32 user devstack@n-api.service[61663]: method: > Apr 14 03:32:32 user devstack@n-api.service[61663]: exception: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:32:32 user devstack@n-api.service[61663]: action_args: {'id': '82dc7444-2886-4be4-b565-99e1cb0a70e4'} Apr 14 03:32:32 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c37d16e0-6d33-4ada-aa03-7e98c2865766 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4" status: 404 len: 111 microversion: 2.1 time: 0.055846 Apr 14 03:32:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 374/1118] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:32:32 2023] DELETE /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:32:32 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:32 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 82dc7444-2886-4be4-b565-99e1cb0a70e4] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:32 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:32 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:32:32 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:32:32 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4 HTTP/1.1 Apr 14 03:32:32 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:32:32 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:32:32 user devstack@n-api.service[61662]: Connection: close Apr 14 03:32:32 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:32:32 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:32:32 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:32:32 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:32:32 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:32 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61662]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:32 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:32:32 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:32:32 user devstack@n-api.service[61662]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:32:32 user devstack@n-api.service[61662]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:32 user devstack@n-api.service[61662]: method: > Apr 14 03:32:32 user devstack@n-api.service[61662]: exception: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:32:32 user devstack@n-api.service[61662]: action_args: {'id': '82dc7444-2886-4be4-b565-99e1cb0a70e4'} Apr 14 03:32:32 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. Apr 14 03:32:32 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 82dc7444-2886-4be4-b565-99e1cb0a70e4 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:32 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-f0956492-c355-46e7-b04b-c0a8fa338400 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4" status: 404 len: 111 microversion: 2.1 time: 0.036306 Apr 14 03:32:32 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 372/1119] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:32:32 2023] GET /compute/v2.1/servers/82dc7444-2886-4be4-b565-99e1cb0a70e4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:32:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:32 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:32:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:32:32 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd HTTP/1.1 Apr 14 03:32:32 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:32:32 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:32:32 user devstack@n-api.service[61664]: Connection: close Apr 14 03:32:32 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:32:32 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:32:32 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:32:32 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:32:32 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:32 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:32 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:32:32 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:32:32 user devstack@n-api.service[61664]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:32:32 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:32 user devstack@n-api.service[61664]: method: > Apr 14 03:32:32 user devstack@n-api.service[61664]: exception: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:32:32 user devstack@n-api.service[61664]: action_args: {'id': '9b91538e-2a4b-453b-bfb3-5e569da0a3cd'} Apr 14 03:32:32 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:32:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-10f44278-835d-4900-abc2-93250579817d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd" status: 404 len: 111 microversion: 2.1 time: 0.029317 Apr 14 03:32:32 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 374/1120] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:32:32 2023] DELETE /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 9b91538e-2a4b-453b-bfb3-5e569da0a3cd] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:32:32 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd HTTP/1.1 Apr 14 03:32:32 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:32:32 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:32:32 user devstack@n-api.service[61663]: Connection: close Apr 14 03:32:32 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:32:32 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:32:32 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:32:32 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:32:32 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:32 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:32:32 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:32:32 user devstack@n-api.service[61663]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:32:32 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:32 user devstack@n-api.service[61663]: method: > Apr 14 03:32:32 user devstack@n-api.service[61663]: exception: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:32:32 user devstack@n-api.service[61663]: action_args: {'id': '9b91538e-2a4b-453b-bfb3-5e569da0a3cd'} Apr 14 03:32:32 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. Apr 14 03:32:32 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 9b91538e-2a4b-453b-bfb3-5e569da0a3cd could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5f878b1e-b339-4b19-816c-5c934087cb4d tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd" status: 404 len: 111 microversion: 2.1 time: 0.053527 Apr 14 03:32:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 375/1121] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:32:32 2023] GET /compute/v2.1/servers/9b91538e-2a4b-453b-bfb3-5e569da0a3cd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:32:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:36 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:36 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:36 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:32:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:32:36 user devstack@n-api.service[61662]: request: DELETE /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 HTTP/1.1 Apr 14 03:32:36 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:32:36 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:32:36 user devstack@n-api.service[61662]: Connection: close Apr 14 03:32:36 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:32:36 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:32:36 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:32:36 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:32:36 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:36 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:36 user devstack@n-api.service[61662]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:36 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:32:36 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:32:36 user devstack@n-api.service[61662]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:32:36 user devstack@n-api.service[61662]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:36 user devstack@n-api.service[61662]: method: > Apr 14 03:32:36 user devstack@n-api.service[61662]: exception: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:32:36 user devstack@n-api.service[61662]: action_args: {'id': '04737acf-2aa7-4f8c-a33d-fa2b50ea29d7'} Apr 14 03:32:36 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:32:36 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:32:36 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:36 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c2f1d86f-e651-4b5f-bf53-3f5aa71b90f0 tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7" status: 404 len: 111 microversion: 2.1 time: 0.027009 Apr 14 03:32:36 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 373/1122] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:32:36 2023] DELETE /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:32:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] [instance: 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] HTTP exception thrown: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:32:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Request method failure captured: Apr 14 03:32:36 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 HTTP/1.1 Apr 14 03:32:36 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:32:36 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:32:36 user devstack@n-api.service[61664]: Connection: close Apr 14 03:32:36 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:32:36 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:32:36 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:32:36 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:32:36 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMX-TydjecojFa9nAzCiSxeAHEkPult8GO5qwOfQsERxuXObYbeKnJonth_wiij7fAJUIiR58o2XsDRSW8pNKt8CDyPSbgzNH3iNUHqkGX51Heg9lrhm-ClqFnInobXpqNCpaaUlhYNvYVV2k8RM_glT5rucIS-dIhqWQxofFUG85jE Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Project-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b689b65111045168cf21c51bf1274f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b689b65111045168cf21c51bf1274f2"}]}] Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Tenant-Id: 3b689b65111045168cf21c51bf1274f2 Apr 14 03:32:36 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376301777 Apr 14 03:32:36 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:36 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:32:36 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:32:36 user devstack@n-api.service[61664]: X-User-Id: c1390cde350341c3ac0275e429146cf8 Apr 14 03:32:36 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-376301777-project-member Apr 14 03:32:36 user devstack@n-api.service[61664]: method: > Apr 14 03:32:36 user devstack@n-api.service[61664]: exception: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:32:36 user devstack@n-api.service[61664]: action_args: {'id': '04737acf-2aa7-4f8c-a33d-fa2b50ea29d7'} Apr 14 03:32:36 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. Apr 14 03:32:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] Returning 404 to user: Instance 04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-62f886e1-c1c6-484f-8b17-3535b487d39b tempest-AttachVolumeNegativeTest-376301777 tempest-AttachVolumeNegativeTest-376301777-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7" status: 404 len: 111 microversion: 2.1 time: 0.030661 Apr 14 03:32:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 375/1123] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:32:36 2023] GET /compute/v2.1/servers/04737acf-2aa7-4f8c-a33d-fa2b50ea29d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] [instance: ce889d46-fac9-4f77-9d66-6e7753d8a0e0] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] HTTP exception thrown: Instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 could not be found. Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Request method failure captured: Apr 14 03:32:45 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 HTTP/1.1 Apr 14 03:32:45 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:32:45 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:32:45 user devstack@n-api.service[61663]: Connection: close Apr 14 03:32:45 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:32:45 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:32:45 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:32:45 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:32:45 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMfOh9IkBaZHCvidW0TFpQSksAoKRodR-T7vklQmaMdjNEF-PbnFwOB85pXGHRWCernhwFvZtPNzpZ0z6f1PgMxDVS-6XtIDstAeBdv1Wfjb0cGEz_ruzJsbyBxC-_4crLdMuGK4qYEqQmu_8XQ1i7igFchtocgI5qBRUI9BsSJiImI Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Project-Id: 1e0979cf1834435bb0007899da52e863 Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestShelveInstance-1966208901 Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0979cf1834435bb0007899da52e863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0979cf1834435bb0007899da52e863"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e0979cf1834435bb0007899da52e863"}]}] Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Tenant: tempest-TestShelveInstance-1966208901 Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Tenant-Id: 1e0979cf1834435bb0007899da52e863 Apr 14 03:32:45 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestShelveInstance-1966208901 Apr 14 03:32:45 user devstack@n-api.service[61663]: X-User: tempest-TestShelveInstance-1966208901-project-member Apr 14 03:32:45 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:32:45 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:32:45 user devstack@n-api.service[61663]: X-User-Id: 61f477304a044148ade1c6acffd30712 Apr 14 03:32:45 user devstack@n-api.service[61663]: X-User-Name: tempest-TestShelveInstance-1966208901-project-member Apr 14 03:32:45 user devstack@n-api.service[61663]: method: > Apr 14 03:32:45 user devstack@n-api.service[61663]: exception: Instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 could not be found. Apr 14 03:32:45 user devstack@n-api.service[61663]: action_args: {'id': 'ce889d46-fac9-4f77-9d66-6e7753d8a0e0'} Apr 14 03:32:45 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 could not be found. Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 could not be found. Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 could not be found. Apr 14 03:32:45 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:32:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Returning 404 to user: Instance ce889d46-fac9-4f77-9d66-6e7753d8a0e0 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-be1d45a1-0998-4ef9-8619-2f08e71ecd87 tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0" status: 404 len: 111 microversion: 2.1 time: 0.036051 Apr 14 03:32:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 376/1124] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:32:45 2023] GET /compute/v2.1/servers/ce889d46-fac9-4f77-9d66-6e7753d8a0e0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 03:32:45 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-d382e9c0-7154-4880-a10c-d1cb4ff16bcd tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] Calling method '.version_select at 0x7ff11a6c4280>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:45 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-d382e9c0-7154-4880-a10c-d1cb4ff16bcd tempest-TestShelveInstance-1966208901 tempest-TestShelveInstance-1966208901-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-472203162" status: 202 len: 0 microversion: 2.1 time: 0.022861 Apr 14 03:32:45 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 374/1125] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 03:32:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-472203162 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:32:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] HTTP exception thrown: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Request method failure captured: Apr 14 03:32:57 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 HTTP/1.1 Apr 14 03:32:57 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:32:57 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:32:57 user devstack@n-api.service[61664]: Connection: close Apr 14 03:32:57 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:32:57 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:32:57 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:32:57 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:32:57 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMexSf_FetfaX7sScDCvzPMHkKdbgIPtEwaIrOJjdq5zUSBDBxemLwJdO38-5CcjOMYQYNA0Xubp3QBpPzkRnFJxdluGE34w9gVnmjsY6a828TFgj1sCr6d7j1iF3IOXrogq2SqZodX-VxAJ-wo7Ax-aO3ZzL8BFaFfwTuQgPCAsINs Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Project-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ed26668c2cb49c38d16ff728d38bef2"}]}] Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Tenant-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:32:57 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:32:57 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:32:57 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:32:57 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:32:57 user devstack@n-api.service[61664]: X-User-Id: f88237b825b24effad17900bbf645ab8 Apr 14 03:32:57 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:32:57 user devstack@n-api.service[61664]: method: > Apr 14 03:32:57 user devstack@n-api.service[61664]: exception: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:32:57 user devstack@n-api.service[61664]: action_args: {'id': '16e9b236-ce8f-4231-af55-e694bc43dde4'} Apr 14 03:32:57 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:32:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:32:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Returning 404 to user: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:32:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-79426efd-ef28-424d-bf90-3bef2bea8b5e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 404 len: 111 microversion: 2.20 time: 0.035934 Apr 14 03:32:57 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 376/1126] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:32:57 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:32:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4fb54082-3f23-4599-8b2a-a54b2c83d8ac tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '.version_select at 0x7ff11a2ec4c0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:32:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4fb54082-3f23-4599-8b2a-a54b2c83d8ac tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931660222" status: 204 len: 0 microversion: 2.20 time: 0.029086 Apr 14 03:32:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 377/1127] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 03:32:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931660222 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:32:59 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:59 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:59 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-5e5626e0-a117-4ffe-8978-f2dd4fe37632 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Action: 'create', calling method: .version_select at 0x7ff11a3e1e10>, body: {"keypair": {"name": "tempest-keypair-980674246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfFuGWkFw8mYzv+IaggMRf+4kNylomilagNfTvTfzgsa+lN2O419d745uDaeH8a9DV6FeEnUxa7jF0bduYzwd6oy11A75oHtaHOK3aTQMv85AGBKT4RMQiCMXlR626PMg=="}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:32:59 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-5e5626e0-a117-4ffe-8978-f2dd4fe37632 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Getting quotas for project 7ed26668c2cb49c38d16ff728d38bef2. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:32:59 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-5e5626e0-a117-4ffe-8978-f2dd4fe37632 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Getting quotas for user f88237b825b24effad17900bbf645ab8 and project 7ed26668c2cb49c38d16ff728d38bef2. Resources: {'key_pairs'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:32:59 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-5e5626e0-a117-4ffe-8978-f2dd4fe37632 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.053983 Apr 14 03:32:59 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 375/1128] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 03:32:59 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 03:33:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1943005007", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "37d06f06-d5c9-414b-bbc2-17c9a433bc16"}], "security_groups": [{"name": "tempest-securitygroup--1030820386"}], "key_name": "tempest-keypair-980674246", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:33:00 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] validate_networks() for [('37d06f06-d5c9-414b-bbc2-17c9a433bc16', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Getting quotas for project 7ed26668c2cb49c38d16ff728d38bef2. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Getting quotas for user f88237b825b24effad17900bbf645ab8 and project 7ed26668c2cb49c38d16ff728d38bef2. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:33:01 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:33:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4af2f2c7-132b-4e80-8cdc-553425212884 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.735855 Apr 14 03:33:01 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 377/1129] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 03:33:00 2023] POST /compute/v2.1/servers => generated 400 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 03:33:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-52c2c437-2d37-4b97-843b-1e9c0e76af89 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:33:01 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-52c2c437-2d37-4b97-843b-1e9c0e76af89 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:33:01 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-52c2c437-2d37-4b97-843b-1e9c0e76af89 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:33:01 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-52c2c437-2d37-4b97-843b-1e9c0e76af89 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:33:01 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-52c2c437-2d37-4b97-843b-1e9c0e76af89 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:33:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-52c2c437-2d37-4b97-843b-1e9c0e76af89 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 200 len: 1275 microversion: 2.20 time: 0.092175 Apr 14 03:33:01 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 378/1130] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:33:01 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:33:03 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-dcfc7eea-1e64-49e6-a950-bc66c508aaba req-dea419a4-8a63-4302-adf3-62f3779f67fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:33:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-dcfc7eea-1e64-49e6-a950-bc66c508aaba req-dea419a4-8a63-4302-adf3-62f3779f67fb service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:33:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-dcfc7eea-1e64-49e6-a950-bc66c508aaba req-dea419a4-8a63-4302-adf3-62f3779f67fb service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:33:03 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-dcfc7eea-1e64-49e6-a950-bc66c508aaba req-dea419a4-8a63-4302-adf3-62f3779f67fb service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:33:03 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-dcfc7eea-1e64-49e6-a950-bc66c508aaba req-dea419a4-8a63-4302-adf3-62f3779f67fb service nova] Creating event network-changed:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:33:03 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-dcfc7eea-1e64-49e6-a950-bc66c508aaba req-dea419a4-8a63-4302-adf3-62f3779f67fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034668 Apr 14 03:33:03 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 376/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:33:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:33:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-5d9b9af0-af7a-4bc0-a582-f4d26c5f5045 req-a49f6236-94da-4772-be3d-f15f18dd3515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "name": "network-vif-plugged", "status": "completed", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:33:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5d9b9af0-af7a-4bc0-a582-f4d26c5f5045 req-a49f6236-94da-4772-be3d-f15f18dd3515 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:33:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5d9b9af0-af7a-4bc0-a582-f4d26c5f5045 req-a49f6236-94da-4772-be3d-f15f18dd3515 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:33:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5d9b9af0-af7a-4bc0-a582-f4d26c5f5045 req-a49f6236-94da-4772-be3d-f15f18dd3515 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:33:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5d9b9af0-af7a-4bc0-a582-f4d26c5f5045 req-a49f6236-94da-4772-be3d-f15f18dd3515 service nova] Creating event network-vif-plugged:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:33:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-5d9b9af0-af7a-4bc0-a582-f4d26c5f5045 req-a49f6236-94da-4772-be3d-f15f18dd3515 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063014 Apr 14 03:33:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 378/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:33:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:33:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-87f5c7c0-684f-4866-be14-174c3b4b2d92 req-5bd6b4d0-8073-426f-a718-1f23960ffd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "name": "network-vif-plugged", "status": "completed", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:33:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-87f5c7c0-684f-4866-be14-174c3b4b2d92 req-5bd6b4d0-8073-426f-a718-1f23960ffd22 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:33:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-87f5c7c0-684f-4866-be14-174c3b4b2d92 req-5bd6b4d0-8073-426f-a718-1f23960ffd22 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:33:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-87f5c7c0-684f-4866-be14-174c3b4b2d92 req-5bd6b4d0-8073-426f-a718-1f23960ffd22 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:33:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-87f5c7c0-684f-4866-be14-174c3b4b2d92 req-5bd6b4d0-8073-426f-a718-1f23960ffd22 service nova] Creating event network-vif-plugged:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:33:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-87f5c7c0-684f-4866-be14-174c3b4b2d92 req-5bd6b4d0-8073-426f-a718-1f23960ffd22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030657 Apr 14 03:33:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 379/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:33:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:33:51 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:33:51 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-5014472a-77ea-4b10-9ef9-3a6223a6169b tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 200 len: 1587 microversion: 2.20 time: 0.213874 Apr 14 03:33:51 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 377/1134] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:33:51 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 1587 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:51 user devstack@n-api.service[61664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 03:34:51 user devstack@n-api.service[61664]: Fri Apr 14 03:34:51 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/os-interface (ip 10.0.0.210) !!! Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8de4a851-b86b-4e7e-a7fe-635d7b9e72b6 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8de4a851-b86b-4e7e-a7fe-635d7b9e72b6 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8de4a851-b86b-4e7e-a7fe-635d7b9e72b6 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8de4a851-b86b-4e7e-a7fe-635d7b9e72b6 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8de4a851-b86b-4e7e-a7fe-635d7b9e72b6 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8de4a851-b86b-4e7e-a7fe-635d7b9e72b6 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8de4a851-b86b-4e7e-a7fe-635d7b9e72b6 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8de4a851-b86b-4e7e-a7fe-635d7b9e72b6 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8de4a851-b86b-4e7e-a7fe-635d7b9e72b6 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.131516 Apr 14 03:34:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 379/1135] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 03:34:51 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/os-interface => generated 283 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:34:52 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:52 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:52 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d7f447bc-9a77-4d43-8918-3262940e6b74 req-0d1cf97a-21ad-4905-a85e-6503983bb39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:34:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d7f447bc-9a77-4d43-8918-3262940e6b74 req-0d1cf97a-21ad-4905-a85e-6503983bb39b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d7f447bc-9a77-4d43-8918-3262940e6b74 req-0d1cf97a-21ad-4905-a85e-6503983bb39b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d7f447bc-9a77-4d43-8918-3262940e6b74 req-0d1cf97a-21ad-4905-a85e-6503983bb39b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d7f447bc-9a77-4d43-8918-3262940e6b74 req-0d1cf97a-21ad-4905-a85e-6503983bb39b service nova] Creating event network-changed:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:34:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d7f447bc-9a77-4d43-8918-3262940e6b74 req-0d1cf97a-21ad-4905-a85e-6503983bb39b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257727 Apr 14 03:34:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 380/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:34:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:34:53 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:53 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:53 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-de77038e-9df9-4fbe-9c2b-d536c2308551 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:34:53 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-de77038e-9df9-4fbe-9c2b-d536c2308551 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:34:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-de77038e-9df9-4fbe-9c2b-d536c2308551 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-de77038e-9df9-4fbe-9c2b-d536c2308551 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-de77038e-9df9-4fbe-9c2b-d536c2308551 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-de77038e-9df9-4fbe-9c2b-d536c2308551 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-de77038e-9df9-4fbe-9c2b-d536c2308551 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:53 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-de77038e-9df9-4fbe-9c2b-d536c2308551 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:53 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-de77038e-9df9-4fbe-9c2b-d536c2308551 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/ips" status: 200 len: 149 microversion: 2.20 time: 0.040663 Apr 14 03:34:53 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 378/1137] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 03:34:53 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 03:34:56 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0abd59c6-5c8c-40ac-bb65-2bc0c9555be3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:34:56 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0abd59c6-5c8c-40ac-bb65-2bc0c9555be3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:34:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0abd59c6-5c8c-40ac-bb65-2bc0c9555be3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0abd59c6-5c8c-40ac-bb65-2bc0c9555be3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0abd59c6-5c8c-40ac-bb65-2bc0c9555be3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0abd59c6-5c8c-40ac-bb65-2bc0c9555be3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0abd59c6-5c8c-40ac-bb65-2bc0c9555be3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0abd59c6-5c8c-40ac-bb65-2bc0c9555be3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:56 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-0abd59c6-5c8c-40ac-bb65-2bc0c9555be3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lazy-loading 'flavor' on Instance uuid 974938c0-18b8-47cd-8c37-4dbe6f228a53 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 03:34:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0abd59c6-5c8c-40ac-bb65-2bc0c9555be3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/action" status: 202 len: 0 microversion: 2.20 time: 0.929317 Apr 14 03:34:57 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 380/1138] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 03:34:56 2023] POST /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/action => generated 0 bytes in 931 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:34:57 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:34:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0424a76f-cf97-40a7-9aad-9c4c64404621 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 200 len: 1711 microversion: 2.20 time: 0.347430 Apr 14 03:34:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 381/1139] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:34:57 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 1711 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:34:57 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-7a76e69e-82eb-40d9-a2fb-7e587150015b req-8bdb95b9-bae3-4baf-88f4-5b4bc2cd4aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "name": "network-vif-unplugged", "status": "completed", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:34:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-7a76e69e-82eb-40d9-a2fb-7e587150015b req-8bdb95b9-bae3-4baf-88f4-5b4bc2cd4aac service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-7a76e69e-82eb-40d9-a2fb-7e587150015b req-8bdb95b9-bae3-4baf-88f4-5b4bc2cd4aac service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:57 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-7a76e69e-82eb-40d9-a2fb-7e587150015b req-8bdb95b9-bae3-4baf-88f4-5b4bc2cd4aac service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:57 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-7a76e69e-82eb-40d9-a2fb-7e587150015b req-8bdb95b9-bae3-4baf-88f4-5b4bc2cd4aac service nova] Creating event network-vif-unplugged:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:34:57 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-7a76e69e-82eb-40d9-a2fb-7e587150015b req-8bdb95b9-bae3-4baf-88f4-5b4bc2cd4aac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032062 Apr 14 03:34:57 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 379/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:34:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:34:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-90a2475b-4c1f-4f5c-bb99-6dc02949816e req-29468ff1-6c77-4951-9f5f-f569a5a34d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "name": "network-vif-plugged", "status": "completed", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:34:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-90a2475b-4c1f-4f5c-bb99-6dc02949816e req-29468ff1-6c77-4951-9f5f-f569a5a34d90 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:34:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-90a2475b-4c1f-4f5c-bb99-6dc02949816e req-29468ff1-6c77-4951-9f5f-f569a5a34d90 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:34:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-90a2475b-4c1f-4f5c-bb99-6dc02949816e req-29468ff1-6c77-4951-9f5f-f569a5a34d90 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:34:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-90a2475b-4c1f-4f5c-bb99-6dc02949816e req-29468ff1-6c77-4951-9f5f-f569a5a34d90 service nova] Creating event network-vif-plugged:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:34:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-90a2475b-4c1f-4f5c-bb99-6dc02949816e req-29468ff1-6c77-4951-9f5f-f569a5a34d90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033220 Apr 14 03:34:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 381/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:34:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:35:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-4976c4cf-36b3-40ef-a285-0171e972e57e req-78e5e36c-105b-4be9-a08b-73feee5f662f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:35:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4976c4cf-36b3-40ef-a285-0171e972e57e req-78e5e36c-105b-4be9-a08b-73feee5f662f service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:35:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4976c4cf-36b3-40ef-a285-0171e972e57e req-78e5e36c-105b-4be9-a08b-73feee5f662f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:35:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4976c4cf-36b3-40ef-a285-0171e972e57e req-78e5e36c-105b-4be9-a08b-73feee5f662f service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:35:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-4976c4cf-36b3-40ef-a285-0171e972e57e req-78e5e36c-105b-4be9-a08b-73feee5f662f service nova] Creating event network-changed:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:35:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-4976c4cf-36b3-40ef-a285-0171e972e57e req-78e5e36c-105b-4be9-a08b-73feee5f662f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033685 Apr 14 03:35:02 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 382/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:35:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:35:47 user devstack@n-api.service[61662]: DEBUG nova.policy [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61662) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:35:47 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-83077d3f-de2b-4d10-bb10-d4dd96da07dc tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 200 len: 1652 microversion: 2.20 time: 0.230103 Apr 14 03:35:47 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 380/1143] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:35:47 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 1652 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:36:47 user devstack@n-api.service[61664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 03:36:47 user devstack@n-api.service[61664]: Fri Apr 14 03:36:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/os-volume_attachments (ip 10.0.0.210) !!! Apr 14 03:36:47 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:47 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-75071e50-196b-4b33-a481-9f044452a87e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5510540-ad8d-48a4-a43a-cc9e891ddfb0"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:36:47 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-75071e50-196b-4b33-a481-9f044452a87e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:36:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75071e50-196b-4b33-a481-9f044452a87e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75071e50-196b-4b33-a481-9f044452a87e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75071e50-196b-4b33-a481-9f044452a87e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75071e50-196b-4b33-a481-9f044452a87e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75071e50-196b-4b33-a481-9f044452a87e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75071e50-196b-4b33-a481-9f044452a87e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-75071e50-196b-4b33-a481-9f044452a87e tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.533008 Apr 14 03:36:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 382/1144] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 03:36:47 2023] POST /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/os-volume_attachments => generated 188 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 03:36:48 user devstack@n-api.service[61663]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0d9e66e-f6c8-41f8-a79f-7f3cf02941b7] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 03:36:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b17ae422-a606-4a11-a26e-76f00739e6f0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:36:48 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b17ae422-a606-4a11-a26e-76f00739e6f0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:36:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b17ae422-a606-4a11-a26e-76f00739e6f0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b17ae422-a606-4a11-a26e-76f00739e6f0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b17ae422-a606-4a11-a26e-76f00739e6f0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b17ae422-a606-4a11-a26e-76f00739e6f0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b17ae422-a606-4a11-a26e-76f00739e6f0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b17ae422-a606-4a11-a26e-76f00739e6f0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b17ae422-a606-4a11-a26e-76f00739e6f0 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/os-volume_attachments/d5510540-ad8d-48a4-a43a-cc9e891ddfb0" status: 202 len: 0 microversion: 2.20 time: 0.272788 Apr 14 03:36:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 383/1145] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 03:36:48 2023] DELETE /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/os-volume_attachments/d5510540-ad8d-48a4-a43a-cc9e891ddfb0 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:36:48 user devstack@n-api.service[61662]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c165ad73-f265-4007-a18f-2abdd6b2eddf] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3e27a45f-188f-42b2-8250-5761b01bf6c7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3e27a45f-188f-42b2-8250-5761b01bf6c7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e27a45f-188f-42b2-8250-5761b01bf6c7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e27a45f-188f-42b2-8250-5761b01bf6c7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e27a45f-188f-42b2-8250-5761b01bf6c7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e27a45f-188f-42b2-8250-5761b01bf6c7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e27a45f-188f-42b2-8250-5761b01bf6c7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3e27a45f-188f-42b2-8250-5761b01bf6c7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:48 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3e27a45f-188f-42b2-8250-5761b01bf6c7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61662) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 03:36:48 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3e27a45f-188f-42b2-8250-5761b01bf6c7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/action" status: 202 len: 0 microversion: 2.20 time: 0.111614 Apr 14 03:36:48 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 381/1146] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 03:36:48 2023] POST /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:36:48 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:36:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ce351fc7-42de-4107-b560-d546aaeb23dd tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 200 len: 1660 microversion: 2.20 time: 0.159085 Apr 14 03:36:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 383/1147] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:36:48 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 1660 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:36:50 user devstack@n-api.service[61663]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0d9e66e-f6c8-41f8-a79f-7f3cf02941b7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 54210. Apr 14 03:36:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-9f231ad9-cbaa-4ce4-a9e3-8624c6a071ef req-25da014c-370f-4468-8a5f-17c9ab83bbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:36:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9f231ad9-cbaa-4ce4-a9e3-8624c6a071ef req-25da014c-370f-4468-8a5f-17c9ab83bbf4 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9f231ad9-cbaa-4ce4-a9e3-8624c6a071ef req-25da014c-370f-4468-8a5f-17c9ab83bbf4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9f231ad9-cbaa-4ce4-a9e3-8624c6a071ef req-25da014c-370f-4468-8a5f-17c9ab83bbf4 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-9f231ad9-cbaa-4ce4-a9e3-8624c6a071ef req-25da014c-370f-4468-8a5f-17c9ab83bbf4 service nova] Creating event network-changed:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:36:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-9f231ad9-cbaa-4ce4-a9e3-8624c6a071ef req-25da014c-370f-4468-8a5f-17c9ab83bbf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090460 Apr 14 03:36:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 384/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:36:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:36:56 user devstack@n-api.service[61662]: INFO oslo.messaging._drivers.impl_rabbit [-] [c165ad73-f265-4007-a18f-2abdd6b2eddf] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 54212. Apr 14 03:36:56 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-b9cd50fb-56ac-48bb-bfd8-68f582db6291 req-921b6fdf-45a8-4a7b-a573-e589d7fb9b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "name": "network-vif-plugged", "status": "completed", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:36:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b9cd50fb-56ac-48bb-bfd8-68f582db6291 req-921b6fdf-45a8-4a7b-a573-e589d7fb9b88 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b9cd50fb-56ac-48bb-bfd8-68f582db6291 req-921b6fdf-45a8-4a7b-a573-e589d7fb9b88 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:56 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-b9cd50fb-56ac-48bb-bfd8-68f582db6291 req-921b6fdf-45a8-4a7b-a573-e589d7fb9b88 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-b9cd50fb-56ac-48bb-bfd8-68f582db6291 req-921b6fdf-45a8-4a7b-a573-e589d7fb9b88 service nova] Creating event network-vif-plugged:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:36:56 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-b9cd50fb-56ac-48bb-bfd8-68f582db6291 req-921b6fdf-45a8-4a7b-a573-e589d7fb9b88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101761 Apr 14 03:36:56 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 382/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:36:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:36:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-21061379-a672-480c-969b-ca06c6b9f4df req-6b3f09de-5b4d-479e-bf13-c8d50382af5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "name": "network-vif-plugged", "status": "completed", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:36:59 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:59 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-21061379-a672-480c-969b-ca06c6b9f4df req-6b3f09de-5b4d-479e-bf13-c8d50382af5b service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:36:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-21061379-a672-480c-969b-ca06c6b9f4df req-6b3f09de-5b4d-479e-bf13-c8d50382af5b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:36:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-21061379-a672-480c-969b-ca06c6b9f4df req-6b3f09de-5b4d-479e-bf13-c8d50382af5b service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:36:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-21061379-a672-480c-969b-ca06c6b9f4df req-6b3f09de-5b4d-479e-bf13-c8d50382af5b service nova] Creating event network-vif-plugged:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:36:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-21061379-a672-480c-969b-ca06c6b9f4df req-6b3f09de-5b4d-479e-bf13-c8d50382af5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Apr 14 03:36:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 384/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:36:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:37:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:37:38 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:37:38 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:37:38 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:37:38 user devstack@n-api.service[61663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 03:37:38 user devstack@n-api.service[61663]: Fri Apr 14 03:37:38 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 (ip 10.0.0.210) !!! Apr 14 03:37:38 user devstack@n-api.service[61663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 03:37:38 user devstack@n-api.service[61663]: Fri Apr 14 03:37:38 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 (ip 10.0.0.210) !!! Apr 14 03:37:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:37:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:37:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:37:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:37:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:37:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:37:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:37:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:37:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:37:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-62d6006b-795d-4522-8848-7c6b28257241 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 200 len: 1705 microversion: 2.20 time: 0.169169 Apr 14 03:37:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 385/1151] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:37:38 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 1705 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:38:39 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:38:39 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:38:39 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-829dd119-17cf-433a-9d26-b0bb637029e7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:38:39 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-829dd119-17cf-433a-9d26-b0bb637029e7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:38:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-829dd119-17cf-433a-9d26-b0bb637029e7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:38:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-829dd119-17cf-433a-9d26-b0bb637029e7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:38:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-829dd119-17cf-433a-9d26-b0bb637029e7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:38:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-829dd119-17cf-433a-9d26-b0bb637029e7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:38:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-829dd119-17cf-433a-9d26-b0bb637029e7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:38:39 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-829dd119-17cf-433a-9d26-b0bb637029e7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:38:39 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-829dd119-17cf-433a-9d26-b0bb637029e7 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058344 Apr 14 03:38:39 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 383/1152] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 03:38:39 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:38:39 user devstack@n-api.service[61664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 03:38:39 user devstack@n-api.service[61664]: Fri Apr 14 03:38:39 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 (ip 10.0.0.210) !!! Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c0bb5e01-8546-40f4-b040-9064f791af42 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c0bb5e01-8546-40f4-b040-9064f791af42 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c0bb5e01-8546-40f4-b040-9064f791af42 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c0bb5e01-8546-40f4-b040-9064f791af42 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c0bb5e01-8546-40f4-b040-9064f791af42 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c0bb5e01-8546-40f4-b040-9064f791af42 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c0bb5e01-8546-40f4-b040-9064f791af42 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c0bb5e01-8546-40f4-b040-9064f791af42 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:38:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c0bb5e01-8546-40f4-b040-9064f791af42 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:38:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c0bb5e01-8546-40f4-b040-9064f791af42 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 204 len: 0 microversion: 2.20 time: 0.145630 Apr 14 03:38:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 385/1153] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:38:39 2023] DELETE /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:38:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f88237b825b24effad17900bbf645ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed26668c2cb49c38d16ff728d38bef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:38:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7803e72c-7ae5-4be7-a10d-20ef58ee2fd2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 200 len: 1711 microversion: 2.20 time: 0.179958 Apr 14 03:38:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 386/1154] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:38:39 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 1711 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 03:38:40 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-5495cd78-db23-486e-8534-04fa46aa213e req-0e9ef9f7-3b1c-4fc9-8f96-e19d742a5094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "name": "network-vif-unplugged", "status": "completed", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:38:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5495cd78-db23-486e-8534-04fa46aa213e req-0e9ef9f7-3b1c-4fc9-8f96-e19d742a5094 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:38:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5495cd78-db23-486e-8534-04fa46aa213e req-0e9ef9f7-3b1c-4fc9-8f96-e19d742a5094 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:38:40 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-5495cd78-db23-486e-8534-04fa46aa213e req-0e9ef9f7-3b1c-4fc9-8f96-e19d742a5094 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:38:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-5495cd78-db23-486e-8534-04fa46aa213e req-0e9ef9f7-3b1c-4fc9-8f96-e19d742a5094 service nova] Creating event network-vif-unplugged:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:38:40 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-5495cd78-db23-486e-8534-04fa46aa213e req-0e9ef9f7-3b1c-4fc9-8f96-e19d742a5094 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031000 Apr 14 03:38:40 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 384/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:38:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:38:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-32ea3447-76da-4007-a6bb-1e7e8926dfc8 req-5c36ce94-81e3-4dcd-bf0d-7da4bfd0fbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "name": "network-vif-deleted", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:38:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-32ea3447-76da-4007-a6bb-1e7e8926dfc8 req-5c36ce94-81e3-4dcd-bf0d-7da4bfd0fbc8 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:38:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-32ea3447-76da-4007-a6bb-1e7e8926dfc8 req-5c36ce94-81e3-4dcd-bf0d-7da4bfd0fbc8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:38:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-32ea3447-76da-4007-a6bb-1e7e8926dfc8 req-5c36ce94-81e3-4dcd-bf0d-7da4bfd0fbc8 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:38:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-32ea3447-76da-4007-a6bb-1e7e8926dfc8 req-5c36ce94-81e3-4dcd-bf0d-7da4bfd0fbc8 service nova] Creating event network-vif-deleted:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:38:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-32ea3447-76da-4007-a6bb-1e7e8926dfc8 req-5c36ce94-81e3-4dcd-bf0d-7da4bfd0fbc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036441 Apr 14 03:38:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 386/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:38:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:38:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ede3163b-965c-4f3f-856a-c86f6b90ebb7 req-db5f4efe-51f9-466f-951b-df90bcf67ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974938c0-18b8-47cd-8c37-4dbe6f228a53", "name": "network-vif-plugged", "status": "completed", "tag": "c8eb45d0-1935-4985-97d4-4a73d14f204d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:38:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ede3163b-965c-4f3f-856a-c86f6b90ebb7 req-db5f4efe-51f9-466f-951b-df90bcf67ade service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:38:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ede3163b-965c-4f3f-856a-c86f6b90ebb7 req-db5f4efe-51f9-466f-951b-df90bcf67ade service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:38:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ede3163b-965c-4f3f-856a-c86f6b90ebb7 req-db5f4efe-51f9-466f-951b-df90bcf67ade service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:38:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ede3163b-965c-4f3f-856a-c86f6b90ebb7 req-db5f4efe-51f9-466f-951b-df90bcf67ade service nova] Creating event network-vif-plugged:c8eb45d0-1935-4985-97d4-4a73d14f204d for instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 on user Apr 14 03:38:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ede3163b-965c-4f3f-856a-c86f6b90ebb7 req-db5f4efe-51f9-466f-951b-df90bcf67ade service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028694 Apr 14 03:38:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 387/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:38:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=8 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:29 user devstack@n-api.service[61662]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 03:39:29 user devstack@n-api.service[61662]: Fri Apr 14 03:39:29 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 (ip 10.0.0.210) !!! Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] HTTP exception thrown: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Request method failure captured: Apr 14 03:39:29 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 HTTP/1.1 Apr 14 03:39:29 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:39:29 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:39:29 user devstack@n-api.service[61662]: Connection: close Apr 14 03:39:29 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:39:29 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:39:29 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:39:29 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:39:29 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMexSf_FetfaX7sScDCvzPMHkKdbgIPtEwaIrOJjdq5zUSBDBxemLwJdO38-5CcjOMYQYNA0Xubp3QBpPzkRnFJxdluGE34w9gVnmjsY6a828TFgj1sCr6d7j1iF3IOXrogq2SqZodX-VxAJ-wo7Ax-aO3ZzL8BFaFfwTuQgPCAsINs Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Project-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ed26668c2cb49c38d16ff728d38bef2"}]}] Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Tenant-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:39:29 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:29 user devstack@n-api.service[61662]: X-User: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:39:29 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:39:29 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:39:29 user devstack@n-api.service[61662]: X-User-Id: f88237b825b24effad17900bbf645ab8 Apr 14 03:39:29 user devstack@n-api.service[61662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:39:29 user devstack@n-api.service[61662]: method: > Apr 14 03:39:29 user devstack@n-api.service[61662]: exception: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:29 user devstack@n-api.service[61662]: action_args: {'id': '974938c0-18b8-47cd-8c37-4dbe6f228a53'} Apr 14 03:39:29 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:29 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:39:29 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Returning 404 to user: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:39:29 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-21a86e2a-19c8-4d1b-9d18-13afcbf4f990 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 404 len: 111 microversion: 2.20 time: 0.039532 Apr 14 03:39:29 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 385/1158] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:39:29 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:39:29 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:29 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-38694a94-8aa5-43ce-8377-7832c40ee6f3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '.version_select at 0x7ff100731900>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:39:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-38694a94-8aa5-43ce-8377-7832c40ee6f3 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980674246" status: 204 len: 0 microversion: 2.20 time: 0.036275 Apr 14 03:39:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 387/1159] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 03:39:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980674246 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] HTTP exception thrown: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Request method failure captured: Apr 14 03:39:34 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 HTTP/1.1 Apr 14 03:39:34 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:39:34 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:39:34 user devstack@n-api.service[61663]: Connection: close Apr 14 03:39:34 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:39:34 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:39:34 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:39:34 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:39:34 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMexSf_FetfaX7sScDCvzPMHkKdbgIPtEwaIrOJjdq5zUSBDBxemLwJdO38-5CcjOMYQYNA0Xubp3QBpPzkRnFJxdluGE34w9gVnmjsY6a828TFgj1sCr6d7j1iF3IOXrogq2SqZodX-VxAJ-wo7Ax-aO3ZzL8BFaFfwTuQgPCAsINs Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Project-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ed26668c2cb49c38d16ff728d38bef2"}]}] Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Tenant-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:39:34 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:34 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:39:34 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:39:34 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:39:34 user devstack@n-api.service[61663]: X-User-Id: f88237b825b24effad17900bbf645ab8 Apr 14 03:39:34 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:39:34 user devstack@n-api.service[61663]: method: > Apr 14 03:39:34 user devstack@n-api.service[61663]: exception: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:34 user devstack@n-api.service[61663]: action_args: {'id': '974938c0-18b8-47cd-8c37-4dbe6f228a53'} Apr 14 03:39:34 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:39:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Returning 404 to user: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:39:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-10b09f78-a3c3-4433-b26f-5d1496c039a2 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 404 len: 111 microversion: 2.20 time: 0.043274 Apr 14 03:39:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 388/1160] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:39:34 2023] DELETE /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:39:34 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:39:34 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 974938c0-18b8-47cd-8c37-4dbe6f228a53] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:39:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:34 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.wsgi [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] HTTP exception thrown: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:34 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Request method failure captured: Apr 14 03:39:34 user devstack@n-api.service[61662]: request: GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 HTTP/1.1 Apr 14 03:39:34 user devstack@n-api.service[61662]: Accept: application/json Apr 14 03:39:34 user devstack@n-api.service[61662]: Accept-Encoding: identity Apr 14 03:39:34 user devstack@n-api.service[61662]: Connection: close Apr 14 03:39:34 user devstack@n-api.service[61662]: Content-Length: 0 Apr 14 03:39:34 user devstack@n-api.service[61662]: Content-Type: application/json Apr 14 03:39:34 user devstack@n-api.service[61662]: Host: 10.0.0.210 Apr 14 03:39:34 user devstack@n-api.service[61662]: Openstack-System-Scope: None Apr 14 03:39:34 user devstack@n-api.service[61662]: User-Agent: python-urllib3/1.26.15 Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Auth-Token: gAAAAABkOMexSf_FetfaX7sScDCvzPMHkKdbgIPtEwaIrOJjdq5zUSBDBxemLwJdO38-5CcjOMYQYNA0Xubp3QBpPzkRnFJxdluGE34w9gVnmjsY6a828TFgj1sCr6d7j1iF3IOXrogq2SqZodX-VxAJ-wo7Ax-aO3ZzL8BFaFfwTuQgPCAsINs Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Domain-Id: None Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Domain-Name: None Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Identity-Status: Confirmed Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Is-Admin-Project: True Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Project-Domain-Id: default Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Project-Domain-Name: Default Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Project-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Role: reader,member Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Roles: reader,member Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ed26668c2cb49c38d16ff728d38bef2"}]}] Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Tenant-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:39:34 user devstack@n-api.service[61662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:34 user devstack@n-api.service[61662]: X-User: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:39:34 user devstack@n-api.service[61662]: X-User-Domain-Id: default Apr 14 03:39:34 user devstack@n-api.service[61662]: X-User-Domain-Name: Default Apr 14 03:39:34 user devstack@n-api.service[61662]: X-User-Id: f88237b825b24effad17900bbf645ab8 Apr 14 03:39:34 user devstack@n-api.service[61662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:39:34 user devstack@n-api.service[61662]: method: > Apr 14 03:39:34 user devstack@n-api.service[61662]: exception: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:34 user devstack@n-api.service[61662]: action_args: {'id': '974938c0-18b8-47cd-8c37-4dbe6f228a53'} Apr 14 03:39:34 user devstack@n-api.service[61662]: {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. Apr 14 03:39:34 user devstack@n-api.service[61662]: ERROR nova.api.openstack.wsgi Apr 14 03:39:34 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Returning 404 to user: Instance 974938c0-18b8-47cd-8c37-4dbe6f228a53 could not be found. {{(pid=61662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:39:34 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-3265b12a-b077-4316-b3be-6ea0f2e130d8 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53" status: 404 len: 111 microversion: 2.20 time: 0.043146 Apr 14 03:39:34 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 386/1161] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:39:34 2023] GET /compute/v2.1/servers/974938c0-18b8-47cd-8c37-4dbe6f228a53 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:39:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:39:37 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:39:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] HTTP exception thrown: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:39:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Request method failure captured: Apr 14 03:39:37 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 HTTP/1.1 Apr 14 03:39:37 user devstack@n-api.service[61664]: Accept: application/json Apr 14 03:39:37 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 14 03:39:37 user devstack@n-api.service[61664]: Connection: close Apr 14 03:39:37 user devstack@n-api.service[61664]: Content-Length: 0 Apr 14 03:39:37 user devstack@n-api.service[61664]: Content-Type: application/json Apr 14 03:39:37 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 14 03:39:37 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 14 03:39:37 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOMexSf_FetfaX7sScDCvzPMHkKdbgIPtEwaIrOJjdq5zUSBDBxemLwJdO38-5CcjOMYQYNA0Xubp3QBpPzkRnFJxdluGE34w9gVnmjsY6a828TFgj1sCr6d7j1iF3IOXrogq2SqZodX-VxAJ-wo7Ax-aO3ZzL8BFaFfwTuQgPCAsINs Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Project-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Role: reader,member Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ed26668c2cb49c38d16ff728d38bef2"}]}] Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Tenant-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:39:37 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:37 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:39:37 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 14 03:39:37 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 14 03:39:37 user devstack@n-api.service[61664]: X-User-Id: f88237b825b24effad17900bbf645ab8 Apr 14 03:39:37 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:39:37 user devstack@n-api.service[61664]: method: > Apr 14 03:39:37 user devstack@n-api.service[61664]: exception: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:39:37 user devstack@n-api.service[61664]: action_args: {'id': '16e9b236-ce8f-4231-af55-e694bc43dde4'} Apr 14 03:39:37 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:39:37 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 14 03:39:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Returning 404 to user: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:39:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ed13177c-a2fe-4333-8ba1-a70aee0cce4a tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 404 len: 111 microversion: 2.20 time: 0.038171 Apr 14 03:39:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 388/1162] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 03:39:37 2023] DELETE /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:39:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:39:37 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] [instance: 16e9b236-ce8f-4231-af55-e694bc43dde4] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:39:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] HTTP exception thrown: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:39:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Request method failure captured: Apr 14 03:39:37 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 HTTP/1.1 Apr 14 03:39:37 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:39:37 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:39:37 user devstack@n-api.service[61663]: Connection: close Apr 14 03:39:37 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:39:37 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:39:37 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:39:37 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:39:37 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMexSf_FetfaX7sScDCvzPMHkKdbgIPtEwaIrOJjdq5zUSBDBxemLwJdO38-5CcjOMYQYNA0Xubp3QBpPzkRnFJxdluGE34w9gVnmjsY6a828TFgj1sCr6d7j1iF3IOXrogq2SqZodX-VxAJ-wo7Ax-aO3ZzL8BFaFfwTuQgPCAsINs Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Project-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ed26668c2cb49c38d16ff728d38bef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ed26668c2cb49c38d16ff728d38bef2"}]}] Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Tenant-Id: 7ed26668c2cb49c38d16ff728d38bef2 Apr 14 03:39:37 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546459049 Apr 14 03:39:37 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:39:37 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:39:37 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:39:37 user devstack@n-api.service[61663]: X-User-Id: f88237b825b24effad17900bbf645ab8 Apr 14 03:39:37 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546459049-project-member Apr 14 03:39:37 user devstack@n-api.service[61663]: method: > Apr 14 03:39:37 user devstack@n-api.service[61663]: exception: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:39:37 user devstack@n-api.service[61663]: action_args: {'id': '16e9b236-ce8f-4231-af55-e694bc43dde4'} Apr 14 03:39:37 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. Apr 14 03:39:37 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:39:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] Returning 404 to user: Instance 16e9b236-ce8f-4231-af55-e694bc43dde4 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:39:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-76a4c105-c71e-4283-9ce0-388b60381d40 tempest-AttachVolumeShelveTestJSON-1546459049 tempest-AttachVolumeShelveTestJSON-1546459049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4" status: 404 len: 111 microversion: 2.20 time: 0.027207 Apr 14 03:39:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 389/1163] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 03:39:37 2023] GET /compute/v2.1/servers/16e9b236-ce8f-4231-af55-e694bc43dde4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 03:39:45 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:45 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:45 user devstack@n-api.service[61662]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 03:39:45 user devstack@n-api.service[61662]: Fri Apr 14 03:39:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 03:39:45 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-712565026", "imageRef": "98e6a247-250b-4bb5-a947-e7f93598d16e", "flavorRef": "42", "networks": [{"uuid": "fbf5eb1c-30a9-4e33-a4da-ef1fef9c24f6"}]}} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:39:45 user devstack@n-api.service[61662]: DEBUG nova.network.neutron [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] validate_networks() for [('fbf5eb1c-30a9-4e33-a4da-ef1fef9c24f6', None, None, None, None, None)] {{(pid=61662) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Flavor limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Image limits 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Flavor pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Image pref 0:0:0 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG nova.virt.hardware [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Getting quotas for project 778eb822f6cb4f9c9c388ee7ed8a2071. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG nova.quota [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Getting quotas for user 2975e8c90d3e41dfa099c98f41635950 and project 778eb822f6cb4f9c9c388ee7ed8a2071. Resources: {'instances', 'cores', 'ram'} {{(pid=61662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Going to run 1 instances... {{(pid=61662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 03:39:46 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] [instance: 536a066d-074b-4a88-94d2-9815421b70da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e6a247-250b-4bb5-a947-e7f93598d16e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 03:39:46 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-c29e92ed-0306-4b0d-a445-7a7a47e80653 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.820417 Apr 14 03:39:46 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 387/1164] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 03:39:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 03:39:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7cf6ea1f-ee86-4cf1-b85e-4a54246f701d tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:39:46 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7cf6ea1f-ee86-4cf1-b85e-4a54246f701d tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] [instance: 536a066d-074b-4a88-94d2-9815421b70da] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:39:46 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7cf6ea1f-ee86-4cf1-b85e-4a54246f701d tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2975e8c90d3e41dfa099c98f41635950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778eb822f6cb4f9c9c388ee7ed8a2071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:39:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7cf6ea1f-ee86-4cf1-b85e-4a54246f701d tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] 10.0.0.210 "GET /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da" status: 200 len: 1207 microversion: 2.1 time: 0.073977 Apr 14 03:39:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 389/1165] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:39:46 2023] GET /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da => generated 1207 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:39:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-624e9842-592a-4525-9045-a4f04739fa48 req-b5242480-f165-4dc9-8b1c-86e887790bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "536a066d-074b-4a88-94d2-9815421b70da", "tag": "8c7a028d-cb6f-4cc7-8469-07fb8c5afe17"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:39:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-624e9842-592a-4525-9045-a4f04739fa48 req-b5242480-f165-4dc9-8b1c-86e887790bce service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-624e9842-592a-4525-9045-a4f04739fa48 req-b5242480-f165-4dc9-8b1c-86e887790bce service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-624e9842-592a-4525-9045-a4f04739fa48 req-b5242480-f165-4dc9-8b1c-86e887790bce service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-624e9842-592a-4525-9045-a4f04739fa48 req-b5242480-f165-4dc9-8b1c-86e887790bce service nova] Creating event network-changed:8c7a028d-cb6f-4cc7-8469-07fb8c5afe17 for instance 536a066d-074b-4a88-94d2-9815421b70da on user Apr 14 03:39:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-624e9842-592a-4525-9045-a4f04739fa48 req-b5242480-f165-4dc9-8b1c-86e887790bce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055948 Apr 14 03:39:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 390/1166] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:39:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:39:50 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-6f06c064-cc0b-47da-9265-a11fb6b85ecb req-006c8712-96c4-46a8-a399-457a638caa8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536a066d-074b-4a88-94d2-9815421b70da", "name": "network-vif-plugged", "status": "completed", "tag": "8c7a028d-cb6f-4cc7-8469-07fb8c5afe17"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:39:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-6f06c064-cc0b-47da-9265-a11fb6b85ecb req-006c8712-96c4-46a8-a399-457a638caa8a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-6f06c064-cc0b-47da-9265-a11fb6b85ecb req-006c8712-96c4-46a8-a399-457a638caa8a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:50 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-6f06c064-cc0b-47da-9265-a11fb6b85ecb req-006c8712-96c4-46a8-a399-457a638caa8a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-6f06c064-cc0b-47da-9265-a11fb6b85ecb req-006c8712-96c4-46a8-a399-457a638caa8a service nova] Creating event network-vif-plugged:8c7a028d-cb6f-4cc7-8469-07fb8c5afe17 for instance 536a066d-074b-4a88-94d2-9815421b70da on user Apr 14 03:39:50 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-6f06c064-cc0b-47da-9265-a11fb6b85ecb req-006c8712-96c4-46a8-a399-457a638caa8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028740 Apr 14 03:39:50 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 388/1167] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:39:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:39:52 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-07bfa8ab-fd4d-4993-8fa8-9f350745185c req-617f4279-8aac-4c70-bff8-9310c749e101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536a066d-074b-4a88-94d2-9815421b70da", "name": "network-vif-plugged", "status": "completed", "tag": "8c7a028d-cb6f-4cc7-8469-07fb8c5afe17"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:39:53 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-07bfa8ab-fd4d-4993-8fa8-9f350745185c req-617f4279-8aac-4c70-bff8-9310c749e101 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:39:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-07bfa8ab-fd4d-4993-8fa8-9f350745185c req-617f4279-8aac-4c70-bff8-9310c749e101 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:39:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-07bfa8ab-fd4d-4993-8fa8-9f350745185c req-617f4279-8aac-4c70-bff8-9310c749e101 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:39:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-07bfa8ab-fd4d-4993-8fa8-9f350745185c req-617f4279-8aac-4c70-bff8-9310c749e101 service nova] Creating event network-vif-plugged:8c7a028d-cb6f-4cc7-8469-07fb8c5afe17 for instance 536a066d-074b-4a88-94d2-9815421b70da on user Apr 14 03:39:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-07bfa8ab-fd4d-4993-8fa8-9f350745185c req-617f4279-8aac-4c70-bff8-9310c749e101 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035979 Apr 14 03:39:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 390/1168] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:39:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8828d1de-d6e0-4229-994d-fa146fed2be1 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-8828d1de-d6e0-4229-994d-fa146fed2be1 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] [instance: 536a066d-074b-4a88-94d2-9815421b70da] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8828d1de-d6e0-4229-994d-fa146fed2be1 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8828d1de-d6e0-4229-994d-fa146fed2be1 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8828d1de-d6e0-4229-994d-fa146fed2be1 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8828d1de-d6e0-4229-994d-fa146fed2be1 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8828d1de-d6e0-4229-994d-fa146fed2be1 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8828d1de-d6e0-4229-994d-fa146fed2be1 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:40:36 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-8828d1de-d6e0-4229-994d-fa146fed2be1 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2975e8c90d3e41dfa099c98f41635950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778eb822f6cb4f9c9c388ee7ed8a2071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:40:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8828d1de-d6e0-4229-994d-fa146fed2be1 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] 10.0.0.210 "GET /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da" status: 200 len: 1484 microversion: 2.1 time: 0.218898 Apr 14 03:40:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 391/1169] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:40:36 2023] GET /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da => generated 1484 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:41:43 user devstack@n-api.service[61662]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c165ad73-f265-4007-a18f-2abdd6b2eddf] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=2 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell0:SELECT=6 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG dbcounter [-] [61662] Writing DB stats nova_cell1:SELECT=4 {{(pid=61662) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [None req-87fd877c-bc0b-467b-b486-72dfdfd33225 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Calling method '>' {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-87fd877c-bc0b-467b-b486-72dfdfd33225 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] [instance: 536a066d-074b-4a88-94d2-9815421b70da] Fetching instance by UUID {{(pid=61662) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-87fd877c-bc0b-467b-b486-72dfdfd33225 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-87fd877c-bc0b-467b-b486-72dfdfd33225 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-87fd877c-bc0b-467b-b486-72dfdfd33225 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-87fd877c-bc0b-467b-b486-72dfdfd33225 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-87fd877c-bc0b-467b-b486-72dfdfd33225 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [None req-87fd877c-bc0b-467b-b486-72dfdfd33225 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:41:43 user devstack@n-api.service[61662]: DEBUG nova.compute.api [None req-87fd877c-bc0b-467b-b486-72dfdfd33225 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] [instance: 536a066d-074b-4a88-94d2-9815421b70da] Going to try to terminate instance {{(pid=61662) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 03:41:43 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [None req-87fd877c-bc0b-467b-b486-72dfdfd33225 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da" status: 204 len: 0 microversion: 2.1 time: 0.150074 Apr 14 03:41:43 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 389/1170] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 03:41:43 2023] DELETE /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 03:41:43 user devstack@n-api.service[61664]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b5ddde7f-af84-4899-a4c5-e217e46037a0] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:43 user devstack@n-api.service[61664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 03:41:43 user devstack@n-api.service[61664]: Fri Apr 14 03:41:43 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da (ip 10.0.0.210) !!! Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-23699ddb-9143-4775-acfe-51864a087bab tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-23699ddb-9143-4775-acfe-51864a087bab tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] [instance: 536a066d-074b-4a88-94d2-9815421b70da] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-23699ddb-9143-4775-acfe-51864a087bab tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-23699ddb-9143-4775-acfe-51864a087bab tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-23699ddb-9143-4775-acfe-51864a087bab tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-23699ddb-9143-4775-acfe-51864a087bab tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-23699ddb-9143-4775-acfe-51864a087bab tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-23699ddb-9143-4775-acfe-51864a087bab tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:41:43 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:43 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-7aa1cb93-e756-4ba4-883b-40aa7b89a91e req-7eb6f238-2c93-4e3d-91f4-d28a55fbc02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536a066d-074b-4a88-94d2-9815421b70da", "name": "network-vif-unplugged", "status": "completed", "tag": "8c7a028d-cb6f-4cc7-8469-07fb8c5afe17"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:41:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7aa1cb93-e756-4ba4-883b-40aa7b89a91e req-7eb6f238-2c93-4e3d-91f4-d28a55fbc02a service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:41:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7aa1cb93-e756-4ba4-883b-40aa7b89a91e req-7eb6f238-2c93-4e3d-91f4-d28a55fbc02a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:41:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7aa1cb93-e756-4ba4-883b-40aa7b89a91e req-7eb6f238-2c93-4e3d-91f4-d28a55fbc02a service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:41:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-7aa1cb93-e756-4ba4-883b-40aa7b89a91e req-7eb6f238-2c93-4e3d-91f4-d28a55fbc02a service nova] Creating event network-vif-unplugged:8c7a028d-cb6f-4cc7-8469-07fb8c5afe17 for instance 536a066d-074b-4a88-94d2-9815421b70da on user Apr 14 03:41:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-7aa1cb93-e756-4ba4-883b-40aa7b89a91e req-7eb6f238-2c93-4e3d-91f4-d28a55fbc02a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044738 Apr 14 03:41:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 392/1171] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:41:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:41:43 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-23699ddb-9143-4775-acfe-51864a087bab tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2975e8c90d3e41dfa099c98f41635950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778eb822f6cb4f9c9c388ee7ed8a2071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 03:41:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-23699ddb-9143-4775-acfe-51864a087bab tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] 10.0.0.210 "GET /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da" status: 200 len: 1490 microversion: 2.1 time: 0.293556 Apr 14 03:41:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 391/1172] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:41:43 2023] GET /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da => generated 1490 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 03:41:45 user devstack@n-api.service[61662]: DEBUG nova.api.openstack.wsgi [req-be523709-2b39-4678-817e-54163471f79c req-5c1d1019-a7a6-45db-8f87-bb42b6a4f2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536a066d-074b-4a88-94d2-9815421b70da", "name": "network-vif-plugged", "status": "completed", "tag": "8c7a028d-cb6f-4cc7-8469-07fb8c5afe17"}, {"server_uuid": "536a066d-074b-4a88-94d2-9815421b70da", "name": "network-vif-deleted", "tag": "8c7a028d-cb6f-4cc7-8469-07fb8c5afe17"}]} {{(pid=61662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 03:41:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-be523709-2b39-4678-817e-54163471f79c req-5c1d1019-a7a6-45db-8f87-bb42b6a4f2c3 service nova] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:41:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-be523709-2b39-4678-817e-54163471f79c req-5c1d1019-a7a6-45db-8f87-bb42b6a4f2c3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:41:45 user devstack@n-api.service[61662]: DEBUG oslo_concurrency.lockutils [req-be523709-2b39-4678-817e-54163471f79c req-5c1d1019-a7a6-45db-8f87-bb42b6a4f2c3 service nova] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61662) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:41:45 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-be523709-2b39-4678-817e-54163471f79c req-5c1d1019-a7a6-45db-8f87-bb42b6a4f2c3 service nova] Creating event network-vif-plugged:8c7a028d-cb6f-4cc7-8469-07fb8c5afe17 for instance 536a066d-074b-4a88-94d2-9815421b70da on user Apr 14 03:41:45 user devstack@n-api.service[61662]: INFO nova.api.openstack.compute.server_external_events [req-be523709-2b39-4678-817e-54163471f79c req-5c1d1019-a7a6-45db-8f87-bb42b6a4f2c3 service nova] Creating event network-vif-deleted:8c7a028d-cb6f-4cc7-8469-07fb8c5afe17 for instance 536a066d-074b-4a88-94d2-9815421b70da on user Apr 14 03:41:45 user devstack@n-api.service[61662]: INFO nova.api.openstack.requestlog [req-be523709-2b39-4678-817e-54163471f79c req-5c1d1019-a7a6-45db-8f87-bb42b6a4f2c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033678 Apr 14 03:41:45 user devstack@n-api.service[61662]: [pid: 61662|app: 0|req: 390/1173] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 03:41:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] [instance: 536a066d-074b-4a88-94d2-9815421b70da] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Acquiring lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Lock "8b826f37-092b-4c7e-8f9e-1e8629c22cd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 03:42:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] HTTP exception thrown: Instance 536a066d-074b-4a88-94d2-9815421b70da could not be found. Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Request method failure captured: Apr 14 03:42:33 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da HTTP/1.1 Apr 14 03:42:33 user devstack@n-api.service[61663]: Accept: application/json Apr 14 03:42:33 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 14 03:42:33 user devstack@n-api.service[61663]: Connection: close Apr 14 03:42:33 user devstack@n-api.service[61663]: Content-Length: 0 Apr 14 03:42:33 user devstack@n-api.service[61663]: Content-Type: application/json Apr 14 03:42:33 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 14 03:42:33 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 14 03:42:33 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOMr_FOvRoSu99AT7d53zXvNiU4hEtnXrK55k55YdKMZOB4ra6Biyc_hvQMpcRIGmbBCc6faRv8mXoe4wCnULkLEBODY6j6R8CFsURjlfHrjEi1AVChAgVMCM77nbRBOLaT-0X-KcLH7S5gVte2qs22QeMKG3Nr-pVw9GK_1uao0tpHA Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Project-Id: 778eb822f6cb4f9c9c388ee7ed8a2071 Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesActionsTest-376578855 Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Role: reader,member Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/778eb822f6cb4f9c9c388ee7ed8a2071"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/778eb822f6cb4f9c9c388ee7ed8a2071"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/778eb822f6cb4f9c9c388ee7ed8a2071"}]}] Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesActionsTest-376578855 Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Tenant-Id: 778eb822f6cb4f9c9c388ee7ed8a2071 Apr 14 03:42:33 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesActionsTest-376578855 Apr 14 03:42:33 user devstack@n-api.service[61663]: X-User: tempest-VolumesActionsTest-376578855-project-member Apr 14 03:42:33 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 14 03:42:33 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 14 03:42:33 user devstack@n-api.service[61663]: X-User-Id: 2975e8c90d3e41dfa099c98f41635950 Apr 14 03:42:33 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesActionsTest-376578855-project-member Apr 14 03:42:33 user devstack@n-api.service[61663]: method: > Apr 14 03:42:33 user devstack@n-api.service[61663]: exception: Instance 536a066d-074b-4a88-94d2-9815421b70da could not be found. Apr 14 03:42:33 user devstack@n-api.service[61663]: action_args: {'id': '536a066d-074b-4a88-94d2-9815421b70da'} Apr 14 03:42:33 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 536a066d-074b-4a88-94d2-9815421b70da could not be found. Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 536a066d-074b-4a88-94d2-9815421b70da could not be found. Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 536a066d-074b-4a88-94d2-9815421b70da could not be found. Apr 14 03:42:33 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 14 03:42:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] Returning 404 to user: Instance 536a066d-074b-4a88-94d2-9815421b70da could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 03:42:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1108ecd2-5aa6-43a6-aa3b-791c8dc0fea8 tempest-VolumesActionsTest-376578855 tempest-VolumesActionsTest-376578855-project-member] 10.0.0.210 "GET /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da" status: 404 len: 111 microversion: 2.1 time: 0.040374 Apr 14 03:42:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 393/1174] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 03:42:33 2023] GET /compute/v2.1/servers/536a066d-074b-4a88-94d2-9815421b70da => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)